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CODING DEVICE AND CODING METHOD 

This is a continuation of copending International Appli- 
cation PCT/aP98/05553 having an international filing date 
of Dec. 8, 1998. 5 

TECHNICAL HELD 

This invention relates to a coding device and a coding 
method, and particularly to a coding device and a coding 
method which enable seamless change of a bit rate at a 10 
halfway point in a GOP while using a rate change algorithm 
defined in TM5, and thus enable effective utilization of the 
capacity of a transmission line. 

BACKGROUND ART 15 

Recently, digital broadcasting for transmitting and receiv- 
ing image data as digital data has been noted. An advantage 
of digital broadcasting is that a greater quantity of program 
data (hereinafter referred to as programs) can be transmitted 
on the same transmission line. This is considerably owing to 20 
the fact that image data can be compressed and transmitted. 
As a method for compressing image data, a bidirectionally 
predictive coding system employed in the MPEG (Moving 
Picture Experts Group) standard is often used. In this 
bidirectionally predictive coding system, three types of 25 
coding is carried out, that is, intra-frame coding, inter-frame 
forward predictive coding and bidirectionally predictive 
coding. Pictures of these coding types are called I-picture 
(intra coded picture), P-picture (predictive coded picture), 
and B-picture (bidirectionally predictive coded picture), 
respectively. 

In compression coding of pictures in digital broadcasting, 
it is necessary to maintain high picture quality while 
restraining the data quantity (bit quantity) after compression 35 
coding to not more than the transmission capacity of the 
transmission line. 

As a method for transmitting a greater number of pro- 
grams to a transmission line of a predetermined transmission 
capacity, a technique of "statistical multiplexing" is known. 40 
The statistical multiplexing technique is a technique for 
dynamically changing the transmission rate of each program 
so as to transmit a greater number of programs. In this 
statistical multiplexing, transmission of a greater number of 
programs is made possible by reducing the transmission rate 45 
of a program such that deterioration in picture quality is 
imperceptible even when the transmission rate is reduced. 

Referring to FIGS. 1 and 2, statistical multiplexing will be 
described further in detail. FIG. 1 shows an exemplary 
allocation bit rate for each program in the conventional case 50 
where multiplexing is carried out at a fixed rate. The vertical 
axis represents the allocation bit rate for each program and 
the horizontal axis represents the time. As shown in FIG. 1, 
the allocation bit rate of each program to be multiplexed 
such as weather forecast, news or drama remains constant 55 
from the bit rate allocated as an initial value, and does not 
vary with the lapse of time. The bit rate allocated to each 
program as the initial value is allocated so that deterioration 
in picture quality of a part (time) where deterioration in 
picture quality of each program is most perceptible falls 60 
within an allowable range. Therefore, a bit rate which is 
more than necessary is not allocated to parts except for the 
part where deterioration in picture quality is perceptible. 

FIG. 2 shows an exemplary allocation bit rate for each 
program in the case where multiplexing is carried out by 65 
dynamically changing the allocation bit rate for each pro- 
gram using the statistical multiplexing technique. The ver- 
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tical axis represents the allocation bit rate for each program 
and the horizontal axis represents the time. Statistical mul- 
tiplexing utilizes the fact that a part (time) where deterio- 
ration in picture quality of each program is perceptible is 
rarely generated in the same time zone. That is, when 
deterioration in picture quality is perceptible in one 
program, deterioration in picture quality of other programs 
is often imperceptible even though the bit rate is lowered. 
Therefore, it is possible to lower the bit rate of the other 
programs and allocate a higher bit rate to the program having 
perceptible deterioration in picture quality. In the example of 
FIG. 2, at a time point tl, the image of drama (1) has 
perceptible deterioration in picture quality but the images of 
news and drama (2) have imperceptible deterioration in 
picture quality. Therefore, the bit rate of the images of new 
and drama (2) is lowered and a higher bit rate is accordingly 
allocated to the image of drama (1). By thus using the 
statistical multiplexing technique, a greater number of pro- 
grams can be transmitted. 

However, there arises a problem of phase of GOP (group 
of pictures). Normally, an encoder encodes images while 
carrying out rate control on the GOP basis, as represented by 
TM5 (Test Model Editing Comnmittee: "Test Model 5"; 
ISO/IEC JTC/SC292/WG11/N400 (Aprill993)). That is, the 
bit rate is not changed at a halfway point of the GOP. If the 
phases of GOP of the respective programs are matched 
(which rarely occurs in general), there is no problem. 
However, if the phases of GOP have discrepancy (which 
generally occurs in most cases), since the bit rate of the 
program is changed only at the leading end of the GOP, the 
bit rates of all the programs cannot be changed at a time. 
Therefore, a dead space (a portion where the bit rate is not 
allocated to any program) is generated, as shown in FIG. 3, 
and all the transmission capacity cannot be effectively used. 

Thus, it may also be considered to employ a technique for 
encoding images while determining the target bit quantity 
for each frame unit instead of carrying out rate control on the 
GOP basis. However, in the case of digital broadcasting, it 
is necessary to strictly control the quantity of generated bits 
so as not to generate overflow or underflow of a VBV (video 
buffering verifier) buffer of a receiver (decoder). If the target 
bit quantity is determined for each frame unit, it is difficult 
to control the quantity of generated bits so as not to generate 
overflow or under of the VBV buffer. 

DISCLOSURE OF THE INVENTION 

In view of the foregoing status of the art, it is an object of 
the present invention to enable bit rate change even at a 
halfway point of a GOP while applying the bit rate changing 
algorithm of TM5, and thus enable effective utilization of 
the capacity of the transmission line. 

A coding device according to the present invention 
includes: control means for calculating a target bit quantity 
allocated to each picture included in a GOP on the basis of 
a designated bit rate; and coding means for coding a coding 
target picture on the basis of the target bit quantity controlled 
by the control means. The control means corrects the target 
bit quantity allocated to the coding target picture on the basis 
of the difference between a first bit rate and a second bit rate 
when the designated bit rate is changed from the first bit rate 
to the second bit rate in the case where coding processing of 
the coding target picture is carried out by the coding means. 

In this coding device, when the designated bit rate is 
changed from the first bit rate to the second bit rate in the 
case where coding processing of the coding target picture is 
carried out by the coding means, the control means corrects 
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the target bit quantity allocated to the coding target picture calculated on the basis of the corrected bit quantity of 

on the basis of the difference between the first bit rate and non-coded pictures. 

the second bit rate. \ coding device according to the present invention 

A coding device according to the present invention includes: control means for calculating an anticipated bit 

includes: control means for calculating a target bit quantity 5 quantity allocated to non-coded pictures up to a picture 

allocated to a coding target picture on the basis of a bit which is ahead of a coding target picture by a predetermined 

quantity allocated to non-coded pictures in a GOP and a number of pictures and distributing the anticipated bit quan- 

designated bit rate; and coding means for coding the coding tity on the basis of coding difficulty of the coding target 

target picture in accordance with the target bit quantity picture so as to calculate a target bit quantity allocated to the 

calculated by the control means. The control means corrects 10 coding target picture; and coding means for coding the 

the target bit quantity provided to the coding means from a coding target picture in accordance with the target bit 

target bit quantity corresponding to a first bit rate to a target quantity calculated by the control means. The control means 

bit quantity corresponding to a second bit rate in the case corrects the target bit quantity provided to the coding means 

where the designated bit rate is changed from the first bit rate from a target bit quantity corresponding to a first bit rate to 

to the second bit rate at a halfway point in the GOP. 35 a target bit quantity corresponding to a second bit rate in the 

In this coding device, in the case where the designated bit case where a designated bit rate is changed from the first bit 

rate is changed from the first bit rate to the second bit rate rate to the second bit rate at a halfway point in a GOP. 

at halfway point in the GOP, the control means corrects the In this coding device, in the case where the designated bit 

target bit quantity provided to the coding means from the rate is changed from the first bit rate to the second bit rate 

target bit quantity corresponding to the first bit rate to the 20 at a halfway point in the GOP, the target bit quantity is 

target bit quantity corresponding to the second bit rate. corrected from the target bit quantity corresponding to the 

A coding device according to the present invention first bit rate to the target bit quantity corresponding to the 

includes: control means for calculating a target bit quantity second bit rate. 

allocated to a coding target picture from a bit quantity 25 A coding device according to the present invention 

allocated to non-coded pictures in a GOP; and coding means includes: control means for calculating an anticipated bit 

for coding the coding target picture in accordance with the quantity allocated to non-coded pictures up to a picture 

target bit quantity calculated by the control means. The which is ahead of a coding target picture by a predetermined 

control means corrects the bit quantity of non-coded pictures number of pictures and distributing the anticipated bit quan- 

so that the locus of change of the bit quantity of non-coded 3Q tity on the basis of coding difficulty of the coding target 

pictures becomes the locus at the time when each picture is picture so as to calculate a target bit quantity allocated to the 

coded at a second bit rate from a leading picture of the GOP, coding target picture; and coding means for coding the 

in the case where a designated bit rate is changed from a first coding target picture in accordance with the target bit 

bit rate to the second bit rate at a halfway point in the GOP quantity calculated by the control means. The control means 

The control means calculates the target bit quantity allocated 35 corrects the anticipated bit quantity allocated to non-coded 

to the coding target picture on the basis of the corrected bit pictures so that the locus of change of the anticipated bit 

quantity of non-coded pictures. quantity allocated to non-coded pictures becomes the locus 

In this coding device, in the case where the designated bit at the time when each picture is coded at a second bit rate, 

rate is changed from the first bit rate to the second bit rate in the case where a designated bit rate is changed from a first 

at a halfway point in the GOP, the bit quantity of non-coded 40 bit rate to the second bit rate at a halfway point in a GOP. 

pictures is corrected so that the locus of change of the bit The control means calculates the target bit quantity allocated 

quantity of non-coded pictures becomes the locus at the time to the coding target picture on the basis of the corrected bit 

when each picture is coded at the second bit rate from the quantity. 

leading picture of the GOP, and the target bit quantity In this coding device, in the case where the designated bit 

allocated to the coding target picture is calculated on the 45 rate is changed from the first bit rate to the second bit rate 

basis of the corrected bit quantity of non-coded pictures. at a halfway point in the GOP, the anticipated bit quantity 

A coding device according to the present invention allocated to non-coded pictures is corrected so that the locus 
includes: control means for calculating a target bit quantity of change of the anticipated bit quantity allocated to non- 
allocated to a coding target picture from a bit quantity coded pictures becomes the locus at the time when each 
allocated to non-coded pictures in a GOP; and coding means 50 picture is coded at the second bit rate, and the target bit 
for coding the coding target picture in accordance with the quantity allocated to the coding target picture is calculated 
target bit quantity calculated by the control means. The on the basis of the corrected bit quantity, 
control means corrects the bit quantity of non-coded pictures a coding device according to the present invention 
from a bit quantity of non-coded pictures based on a first bit includes: control means for calculating an anticipated bit 
rate to a bit quantity of non-coded pictures based on a second 55 quantity allocated to non-coded pictures up to a picture 
bit rate in the case where a designated bit rate is changed which is ahead of a coding target picture by a predetermined 
from the first bit rate to the second bit rate at a halfway point number of pictures and distributing the anticipated bit quan- 
in the GOP. The control means calculates the target bit tity on the basis of coding difficulty of the coding target 
quantity allocated to the coding target picture on the basis of picture so as to calculate a target bit quantity allocated to the 
the corrected bit quantity of non-coded pictures. $o coding target picture; and coding means for coding the 

In this coding device, in the case where the designated bit coding target picture in accordance with the target bit 

rate is changed from the first bit rate to the second bit rate quantity calculated by the control means. The control means 

at a halfway point in the GOP, the bit quantity of non-coded corrects the bit quantity allocated non -coded pictures from a 

pictures is corrected from the bit quantity of non-coded bit quantity of non-coded pictures based on a first bit rate to 

pictures based on the first bit rate to the bit quantity of 65 a bit quantity of non-coded pictures based on a second bit 

non-coded pictures based on the second bit rate, and the rate in the case where a designated bit rate is changed from 

target bit quantity allocated to the coding target picture is the first bit rate to the second bit rate at a halfway point in 
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a GOP. The control means calculates the target bit quantity at a halfway point in the GOP, the bit quantity of non-coded 

allocated to the coding target picture on the basis of the pictures is corrected so that the locus of change of the bit 

corrected bit quantity of non-coded pictures. quantity of non-coded pictures becomes the locus at the time 

In this coding device, in the case where the designated bit when each picture is coded at the second bit rate from the 

rate is changed from the first bit rate to the second bit rate 5 leading picture of the GOP, and the target bit quantity 

at a halfway point in the GOP, the bit quantity allocated allocated to the coding target picture is calculated on the 

non-coded pictures is corrected from the bit quantity of basis of the corrected bit quantity of oon-coded pictures, 

non-coded pictures based on the first bit rate to the bit A coding method according to the present invention 

quantity of non-coded pictures based on the second bit rate, includes: a control step of calculating a target bit quantity 

and the target bit quantity allocated to the coding target 10 allocated to a coding target picture from a bit quantity 

picture is calculated on the basis of the corrected bit quantity allocated to non-coded pictures in a GOP; and a coding step 

of non-coded pictures. of coding the coding target picture in accordance with the 

A coding method according to the present invention target bit quantity calculated by the control step. At the 

includes: a control step of calculating a target bit quantity control step, in the case where a designated bit rate is 

allocated to each picture included in a GOP on the basis of 15 changed from a first bit rate to a second bit rate at a halfway 

a designated bit rate; and a coding step of coding a coding point in the GOP, the bit quantity of non-coded pictures is 

target picture on the basis of the target bit quantity controlled corrected from a bit quantity of non-coded pictures based on 

by the control step. At the control step, when the designated the first bit rate to a bit quantity of non-coded pictures based 

bit rate is changed from a first bit rate to a second bit rate in on the second bit rate, and the target bit quantity allocated to 

the case where coding processing of the coding target picture 20 the coding target picture is calculated on the basis of the 

is carried out by the coding step, the target bit quantity corrected bit quantity of non-coded pictures, 

allocated to the coding target picture is corrected on the basis In this coding method, in the case where the designated bit 

of the difference between the first bit rate and the second bit rate is changed from the first bit rate to the second bit rate 

rate. at a halfway point in the GOP, the bit quantity of non-coded 

In this coding method, when the designated bit rate is 25 pictures is corrected from the bit quantity of non-coded 

changed from the first bit rate to the second bit rate in the pictures based on the first bit rate to the bit quantity of 

case where coding processing of the coding target picture is non-coded pictures based on the second bit rate, and the 

carried out by the coding step, the target bit quantity target bit quantity allocated to the coding target picture is 

allocated to the coding target picture is corrected on the basis calculated on the basis of the corrected bit quantity of 

of the difference between the first bit rate and the second bit 30 non-coded pictures. 

rate. A coding method according to the present invention 

A coding method according to the present invention includes: a control step of calculating an anticipated bit 

includes: a control step of calculating a target bit quantity quantity allocated to non-coded pictures up to a picture 

allocated to a coding target picture on the basis of a bit 35 which is ahead of a coding target picture by a predetermined 

quantity allocated to non-coded pictures in a GOP and a number of pictures and distributing the anticipated bit quan- 

designated bit rate; and a coding step of coding the coding tity on the basis of coding difficulty of the coding target 

target picture in accordance with the target bit quantity picture so as to calculate a target bit quantity allocated to the 

calculated by the control step. At the control step, in the case coding target picture; and a coding step of coding the coding 

where the designated bit rale is changed from a first bit rate ^ target picture in accordance with the target bit quantity 

to a second bit rate at a halfway point in the GOP, the target calculated by the control step. At the control step, in the case 

bit quantity provided to the coding step is corrected from a where a designated bit rate is changed from a first bit rate to 

target bit quantity corresponding to the first bit rate to a a second bit rate at a halfway point in a GOP, the target bit 

target bit quantity corresponding to the second bit rate. quantity provided to the coding step is corrected from a 

In this coding method, in the case where the designated bit 45 target bit quantity corresponding to the first bit rate to a 

rate is changed from the first bit rate to the second bit rate target bit quantity corresponding to the second bit rate, 

at a halfway point in the GOP, the target bit quantity is In this coding method, in the case where the designated bit 

corrected from the target bit quantity corresponding to the rate is changed from the first bit rate to the second bit rate 

first bit rate to the target bit quantity corresponding to the at a halfway point in the GOP, the target bit quantity is 

second bit rate. 50 corrected from the target bit quantity corresponding to the 

A coding method according to the present invention first bit rate to the target bit quantity corresponding to the 

includes: a control step of calculating a target bit quantity second bit rate. 

allocated to a coding target picture from a bit quantity A coding method according to the present invention 

allocated to non-coded pictures in a GOP; and a coding step includes: a control step of calculating an anticipated bit 

of coding the coding target picture in accordance with the 55 quantity allocated to non-coded pictures up to a picture 

target bit quantity calculated by the control step. At the which is ahead of a coding target picture by a predetermined 

control step, in the case where a designated bit rate is number of pictures and distributing the anticipated bit quan- 

changed from a first bit rate to a second bit rate at a halfway tity on the basis of coding difficulty of the coding target 

point in the GOP, the bit quantity of non-coded pictures is picture so as to calculate a target bit quantity allocated to the 

corrected so that the locus of change of the bit quantity of 60 coding target picture; and a coding step of coding the coding 

non-coded pictures becomes the locus at the time when each target picture in accordance with the target bit quantity 

picture is coded at the second bit rate from a leading picture calculated by the control step. At the control step, in the case 

of the GOP, and the target bit quantity allocated to the coding where a designated bit rate is changed from a first bit rate to 

target picture is calculated on the basis of the corrected bit a second bit rate at a halfway point in a GOP, the anticipated 

quantity of non-coded pictures. 55 bit quantity allocated to non-coded pictures is corrected so 

In this coding method, in the case where the designated bit that the locus of change of the anticipated bit quantity 

rate is changed from the first bit rate to the second bit rate allocated to non-coded pictures becomes the locus at the 
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time when each picture is coded at the second bit rate, and FIG. 13 illustrates changes of the capacity of the VBV 

the target bit quantity allocated to the coding target picture buffer. 

is calculated on the basis of the corrected bit quantity. piG. 14 illustrates changes of the bit quantity R. 

In this coding method, in the case where the designated bit pro. j 5 illustrates changes of the bit quantity R in the case 

rate is changed from the first bit rate to the second bit rate 5 whefe lfae b{{ mc ^ changed at a ^if^y po mt G f G OP. 

at a halfway point in the GOP, the anticipated bit quantity nG u {b& f ^ « e „ of su 

allocated to non-coded pictures is corrected so that the locus ^ ^ r 

of change of the anticipated bit quantity allocated to non- , , , - 

coded pictures becomes the locus at the time when each FIG ' 17 f a b ! ock dia g ram showm & another exemplary 

picture is coded at the second bit rate, and the target bit io structure of the image multiplexing system to which the 

quantity allocated to the coding target picture is calculated P rescnt lDventl0n 15 a PP hed - 

on the basis of the corrected bit quantity. FIG. 18 is a block diagram showing an exemplary struc- 

A coding method according to the present invention ture of an ima S e coding device 2-1 of FIG. 17. 

includes: a control step of calculating an anticipated bit FIG. 19 is a flowchart for explaining the operation of the 

quantity allocated to non-coded pictures up to a picture 15 image coding device 2-1 of FIG. 18. 

which is ahead of a coding target picture by a predetermined FIG. 20 is a flowchart for explaining the operation of the 

number of pictures and distributing the anticipated bit quan- image coding device 2-1 of FIG. 18. 

tity on the basis of coding difficulty of the coding target F IG. 21 illustrates changes of the bit quantity R'. 

picture so as to calculate a target bit quantity allocated to the FIG. 22 illustrates changes of the bit quantity G. 

FIG - 23 mustrates chaD * es of the bit *™*y R ' » the 

target picture in accordance with the target bit quantity , . . . , . , , , , * «.~,™ 

calculated by the control step. At the control step, in the case case where the blt ratc 15 chan * ed at a halfwa y P° mt of 
where a designated bit rate is changed from a first bit rate to FIG. 24 illustrates changes of the bit quantity G in the case 
a second bit rate at a halfway point in a GOP, the bit quantity where ^ blt rate 15 changed at a halfway pomt of GOP. 

allocated non-coded pictures from a bit quantity of non- 25 FIG. 25 illustrates the function of a correction value "e" 
coded pictures based on the first bit rate to a bit quantity of at steps S46 and S47 of FIG. 20. 

non-coded pictures based on the second bit rate, and the FIG. 26 illustrates a reversal phenomenon of the bit 
target bit quantity allocated to the coding target picture is quantity R. 

calculated on the basis of the corrected bit quantity of FIG. 27 illustrates a cause of the reversal phenomenon of 

non-coded pictures. 30 the bit quantity R. 

In this coding method, in the case where the designated bit FIG. 28 illustrates the principle for restraining the reversal 
rate is changed from the first bit rate to the second bit rate phenomenon of the bit quantity R. 
at a halfway point in the GOP, the bit quantity allocated 

non-coded pictures is corrected from the bit quantity of ^ BEST MODE FORjCARRYING OUT THE 

non-coded pictures based on the first bit rate to the bit 



35 INVENTION 



quantity of non-coded pictures based on the second bit rate, Preferred embodiments of the present invention will now 

and the target bit quantity allocated to the coding target be described in dctail ^ib re f er ence to the drawings. FIG. 

picture is calculated on the basis of the corrected bit quantity 4 shows an exemplary structure of an image multiplexing 

of non-coded pictures. ^ system 1 to which the present invention is applied. The 

BRIEF DESCRIPTION OF THE DRAWINGS multiplexing system 1 has a plurality of image coding 

devices 2-i for inputting and compression-coding programs 

FIG. 1 illustrates multiplexing using a fixed rate. P i (j. lf 2, . . . , n) as program data of the present invention, 

FIG. 2 illustrates multiplexing using statistical multiplex- a controller 3 for carrying out feedback-like control of the bit 

ing. 45 rate with respect to the individual image coding devices 2-i, 

FIG. 3 illustrates changes of a bit allocation rate in the and a multiplexer 4 for multiplexing compression-coded 

case where phases of GOP are not matched in statistical data sti outputted from the image coding devices 2-i and 

multiplexing. outputting image data Sm to a transmission line. The image 

FIG. 4 is a block diagram showing an exemplary structure codin S devices 2-i find the complexity (global complexity) 

of an image multiplexing system to which the present 50 ci of the programs Pi and output the complexity Ci to the 

invention is applied controller 3. On the basis of the global complexity Ci from 

HG. 5 is a block diagram showing an exemplary structure ' he ^age coding devices 2-i, the controller 3 determines the 

of an image coding device 2-1 of FIG. 4. blt ratc °U_rate#i of the image coding devices 2-i by 
, . „ . - ... . .. , statistical multiplexing and outputs the determined bit rate to 

TO. 6 is a flowchart for explaining the operation of the the i mage coding devices 2-i. 

image coding device 2-1 of FIG. 5. , . ... .... ... 

™„ _. a . A c , . - . In the case where the image multiplexing system 1 is used 

■ HG ' 7 J 3 ^ ch ^\^/^^ the °P eratl0Q of the as a transmission system, the image data Sm outputted from 

image coding device 2-1 of FIG. 5. ^ muUiplexer / is outputted * transmission P data l0 a 

HG. 8 illustrates changes of the capacity of a VBV buffer. transmission line. On the other hand, in the case where ihe 

HG. 9 illustrates changes of the capacity of the VBV 60 j mage multiplexing system 1 is used as a broadcasting 

buffer, system, the image data Sm outputted from the multiplexer 4 

FIG. 10 illustrates changes of the capacity of the VBV is transmitted as broadcast data to a receiving device through 

buffer. a transmission line for broadcasting. 

FIG. 11 illustrates changes of the capacity of a VBV FIG. 5 is a block diagram showing the detailed structure 

buffer. 65 of the image coding device 2-1 of FIG. 4. (Although not 

FIG. 12 illustrates changes of the capacity of the VBV shown, the image coding devices 2-2 to 2-n are similarly 

buffer. constituted.) As shown in FIG. 5, the image coding device 
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2-1 has a picture rearrangement circuit 11 for inputting a Xp-spxQp (2) 

program PI and rearranging the order of pictures (I -picture, xb-SbxQb (3) 
P-picture, B-picture) in accordance with the coding order, 

and a scan conversion macroblock forming circuit 12 for i n the above-mentioned equations, Xi, Xp and Xb express 

inputting output data of the picture rearrangement circuit 11, 5 the global complexity CI of I-picture, P-picture and 

then discriminating whether the output data has a frame B-picture, respectively. Si, Sp and Sb express the quantity of 

structure or a field structure, then carrying out scan conver- generated bits SI in the case where I-picture, P-picture and 

sion in accordance with the discrimmation result and car- B . picture m coded by the variable-length coding circuit 16. 

tying out macroblock forming of 16x16 pixels. A motion Qi> Q and Qb e lhe quantizer misi code Q1 m 

detection circuit 21 searches for a noted macroblock in a i[n ^ P . picture ^ 6 B _ picture , respectively, 

picture as a compression coding target on the basis of output global complexity CI is necessarily coincident with 

data of the scan conversion macroblock forming circuit 12, ,V ni j- r jV j L .» * 

and also searches for a macroblock (predictive macroblock) the m & D \™* in ? ^-forward bit rate 

in a reference picture having the minimum absolute value y fi em * W ^ C ^ WlU be later de5 f nbed ™ th refere " ce 

sum or square sum of difference in pixel value from the 10 nGS - 17 and £ However, it is substantially coincident 

noted macroblock. Then, the motion detection circuit 21 35 with the codmg difficuUy Dl unless the quantizer scale code 

detects a motion vector MV from these macroblocks and Q 1 IS extremely large or small. 

sends the motion vector MV to a motion compensation ™* complexity calculation circuit 31 outputs the corn- 
circuit 22 plexity CI (Xi, Xp, Xb) found by arithmetic operation in 
Asubtracter 13 subtracts predictive image data (predictive , %£™ c ^ th equations (1) I to (3), to the controller 3 
macroblock) generated by the motion compensation circuit 20 0 FIG. 4. The complexity calculation circuit 31 also outputs 
22 on the basis of the motion vector MV from the motion ' he £1 together with the quantity of generated 
detection circuit 21, from the output of the scan conversion ^ts SI (Si, Sp, Sb) to a target bit quantity -setting circuit 32 
macroblock forming circuit 12, and outputs the subtraction ™ e tal Bfi *»» I" 30 ' 1 ? siting circuit 32 sets a target bit 
result to a DCT (discrete cosine transform) circuit 14. The 9 uantl * Tl based on the Signal bit_jate#l suppl.ed from the 
DCT circuit 14carriesoutDCTofinputteddataand outputs 25 controller 3 and the complexity CI and the quantity of 
the DCT result to a quantization circuit 15. The quantization S e , ner 1 ated b,ls S1 (fj> S P> Sb > su PP 1 | ed from 'he complexity 
circuit 15 quantizes the data inputted from the DCT circuit calculation circuit 31, and outputs the set target bit quantity 
14 on the basis of a quantizer scale code Ql outputted from 71 ,0 the I"""*" "? le code determination circuit 33. The 
a quantizer scale code determination circuit 33 of a rate 1 uantaer code determinate c>rcuit 33 determines the 
controller 23, and outputs the quantized data to a variable- 30 1 uantl ^ r <*>de Ql in accordance with the inputted 
length coding circuit 16 and an inverse quantization circuit ^ et b ' 1 n > and out P uts quantizer scale code 
lg Ql to the quantization circuit 15 and the complexity calcu- 

The variable-length coding circuit 16 carries out variable- lation circuit 31. 

. * . , . ,r a i_ ■ The operation of the image multiplexing system 1 shown 

length codmg of the data inputted from the quantization 3J fa rg. 4^, now be desc 4 ed . fe^in^ multiplexing 

circuit 15 and outputs the coded data to the multiplexer 4 i , . , , . • . j- 

,„ r ^-rrn .t . r.u system 1, each program Pi is coded by each image coding 

through a buffer memory 17. The usable capacity of the / . j- j • i i . 7u t u i 

1 _ rr & „_ . : ii j L * ii <%a device 2-i. The image codmg device 2-i calculates the global 

buffer memory 17 is controlled by a controller 24. , .. 0 . & . . & , . *^ u . , 

J . . . -„ . . complexity Ciexpressmg the complexity of the image which 

TTie inverse quantization circuit 18 caries out inverse fe alread with c{ {Q ^ m pi> and Q 

quantization of the data supplied from the quantization ^ lhe ca i cu i ale d global complexity Ci to the controller 3. On 

circuit 15 and outputs the inversely quantized data to an ^ basisof the m tted ^ obal complexity Ci, the controller 

inverse DCT circuit 19. The inverse DCT circuit 19 carries 3 determines me target bil rale bit _ rat e#i as a target bit rate, 

out inverse DCT of the data supplied from the inverse which is a larget quan tity of generated bits per unit time with 

quantization circuit 18 and outputs the inverse DCT result to t tQ eacfa K b using a statistical multiplex- 

an adder 20. The adder 20 adds the predictive image data 45 m technique> outputs the determined target bit rate to 

outputted from the motion compensation circuit 22 and I the tfac . codin device 2 ^ Qa tfae basis of the . Ued 

data outputted from the inverse DCT circuit 19. The adder t bit fate bit _ rate#i> the image coding dev ice 2-i 

20 then outputs to the motion compensation cucuit 22 the compre ssion-codes the program Pi and outputs 

original image data (locally decoded image data) obtained compression-coded data sti to the multiplexer 4. The mul- 

by addition, and causes the motion compensation circuit 22 5Q ti kxcf 4 multiplexes the inputled compression-coded data 

to store the image data into its built-in frame memory. ^ tQ genefate image data Sm for output> aQ(j outputs the 

The rate controller 23 generates the quantizer scale code - migc data Sm t0 ^ transmission line. 

Ql based on the signal bit_rate#l from the controller 3 of basic operation of the image coding device 2-1 shown 

FIG. 4 and the quantity of generated bits SI from the buffer in FIG 5 win now be described. First, the picture rearrange- 

memory 17, and outputs the quantizer scale code Ql to the 55 ment circuit u of the coding device 2 _i rearranges 

quantization circuit 15. Therefore, a complexity calculation lhe order of pictures (I-picture, P-picture and B-picture) of 

circuit 31 of the rate controller 23 calculates the global the pr o g ram PI in accordance with the coding order. Then, 

complexity CI in accordance with the following equations lhc scan conversion macroblock forming circuit 12 discrimi- 

(where Xi, Xp and Xb represent the global complexity). The nates wn ether the pictures have a fame structure or a field 

global complexity CI is data indicating the complexity of 60 slruc ture, and carries out scan conversion and macroblock 

the pattern of compressed image data, and its value is forming in accordance with the discrimination result. The 

obtained by multiplying the quantity of generated bits (data output data of lhe ^ conversion macroblock forming 

quantity) SI of the compressed image data (supplied from circuil 12 is to the motion detection circuit 21 and the 

the buffer memory 17) and the quantizer scale code Ql subtracter 13. 

(supplied from the quantizer scale code determination circuit 65 , f lhe inputted picture is I-picture, no difference from 

predictive image data is taken by the subtracter 13. The 

Xi-sixQi (1) output data of the scan conversion macroblock forming 
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circuit 12 is inputted directly to the DCT circuit 14 and is 
converted to a DCT coefficient. The DCT coefficient is 
quantized by the quantization circuit 15 on the basis of the 
quantizer scale code Ql determined by the quantizer scale 
code determination circuit 33, and is then coded by variable- 5 
length coding by the variable-length coding circuit 16. The 
output data of the variable-length coding circuit 16 is 
temporarily held by the buffer memory 17, and is then 
outputted to the multiplexer 4 as compression-coded data stl 
made up of bit streams. 10 

The inverse quantization circuit 18 inversely quantizes the 
output data of the quantization circuit 15. The inverse DCT 
circuit 19 carries out inverse DCT of the output data of the 
inverse quantization circuit 18 and inputs the inverse DCT 
data to the motion compensation circuit 22 through the adder 
20 so as to hold the data in the motion compensation circuit 
22. 

If the inputted picture is P-picture, the motion compen- 
sation circuit 22 generates predictive image data based on 
image data corresponding to the past I-picture or P-picture 
held therein and the motion vector MV from the motion 
detection circuit 21, and the predictive image data is out- 
putted to the subtracter 13 and the adder 20. The subtracter 
13 calculates the difference between the output data from the 
scan conversion macroblock forming circuit 12 and the 
predictive image data from the motion compensation circuit 
22. This differential data is converted to a DCT coefficient 
by the DCT circuit 14 and is then quantized by the quanti- 
zation circuit 15. The variable-length coding circuit 16 
carries out variable-length coding of the output data from the 30 
quantization circuit 15 and outputs the resultant data as 
compression-coded data stl to the multiplexer 4 through the 
buffer memory 17. 

The inverse quantization circuit 18 inversely quantizes the 
output data of the quantization circuit 15. The inverse DCT 35 
circuit 19 carries out inverse DCT of the output data of the 
inverse quantization circuit 18. The adder 20 adds the output 
data of the inverse DCT circuit 19 and the predictive image 
data outputted from the motion compensation circuit 22, and 
inputs the added data to the motion compensation circuit 22 40 
so as to hold the data therein. 

If the inputted picture is B-picture, the motion compen- Kp-i.o 
sation circuit 22 generates predictive image data based on 
two image data corresponding to the past and future Kb-1.4 
I-picturcs or P-pictures held therein and two motion vectors 
MV from the motion detection circuit 21, and the predictive 
image data is outputted to the subtracter 13 and the adder 20. 
The subtracter 13 calculates the difference between the 
output data of the scan conversion macroblock forming 
circuit 12 and the predictive image data from the motion 
compensation circuit 22. This differential data is converted 
to a DCT coefficient by the DCT circuit 14 and is then 
quantized by the quantization circuit 15. The variable-length 
coding circuit 16 carries out variable-length coding of the 
output data of the quantization circuit 15 and outputs the 
resultant data as compression-coded data stl to the multi- 
plexer 4 through the buffer memory 17. B-picture is not held 
by the motion compensation circuit 22. 

The rate control operation of the rate controller 23 and the 
controller 24 will now be described with reference to the 
flowcharts of FIGS. 6 and 7. In the following description, the 
subscript "i" as in the quantity of generated bits Si, global 
complexity Ci, target bit quantity H, quantizer scale code 
Qi, compression-coded data (coded stream) sti and bit rate 

bit rate#i corresponding to each program Pi is basically 65 

omitted in order to avoid complication of symbols, except 
for the case where these must be discriminated individually. 



In a GOP (group of pictures) defined in accordance with 
the MPEG standard, the j-th picture is expressed as a picture 
(j), and the (j+l)th picture is expressed as a picture (j+1)- 
The number of pictures included in the GOP is denoted by 
N. 

In the following description, pictures up to the picture (j) 
are coded at a first bit rate bit_rate(j), and pictures from the 

picture (j+1) are coded at a second bit rate bit rate(j+l). 

At step SI, the target bit quantity setting circuit 32 of the 
rate controller 23 calculates target bit quantities Ti(j), Tp(j), 
Tb(j) with respect to the picture (j) as the j-th picture in the 
GOP, in accordance with the following equations (4) to (6). 



/?(;) 



i + - 



N b X b 



, bii_rate(j)/(Zxpic_rQte) 



N b K p X b 



, bit_raie(j)/{% x picjrcae) 



NpKbXp 
KpX b 



bit_rate{j)l{% x pic_raie) 



(4) 



(5) 



(6) 



45 



50 



55 



In the above equations, R(j) expresses the bit quantity 
allocated to an non-coded picture which has not been coded 
(that is, a picture to be coded from now on) in the GOP 
including the picture (j) as a coding target. In short, this R(j) 
is a value obtained by adding bit quantities that should be 
allocated to the picture (j), picture (j+l)> • • > picture (N). 
Np and Nb express the number P-pictures or B-pictures 
which have not been coded in the GOP. Xi, Xp and Xb 
express the global complexity C of I-picture, P-picture and 
B-picture, respectively. Kp and Kb express the ratio of the 
quantizer scale code of P-picture and B-picture with refer- 
ence to the quantizer scale code of I-picture, and take values 
expressed by the following equations. 

CO 
(8) 

That is, the quantizer scale code of P-picture is once the 
quantizer scale code of I-picture, but the quantizer scale 
code of B-picture is constantly 1.4 times the quantizer scale 
code of I-picture and P-picture. Thus, since B-picture is 
coded relatively roughly in comparison with I-picture or 
P-picture, the bit quantity that can be saved in B-picture can 
be added to the bit quantity of I-picture and P-picture. 
Therefore, the S/N ratio of I-picture and P-picture is 
improved and the S/N ratio of B-picture which refers to the 
S/N ratio of I-picture and P-picture is also improved. The 
overall S/N ratio is thus improved. 

The initial values of the complexity Xi, Xp, Xb are set at 
values expressed by the following equations based on the 
target bit rate bit rate(j) (bits/sec). 



60 



Xi=160xbit_rate(j)/115 
Xp-60xbit_rale(j)/H5 
Xb-42xbit_rate(j)/115 



(9) 
(10) 
(U) 



BiL 



jate(j) expresses the bit rate which has been desig- 
nated with respect to the pictures up to the picture (j) by the 
controller 3. Pic_rate expresses the picture rate. For 
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example, in the case of the NTSC system, this picture rate vbv_j»ize(j+i) min {xmaxxbiL_raic(j+i), vbv_size(0)} (13) 

is 30 (frames/sec). Max{A,B} expresses a function selecting , v , _ , 

the greater one of A and B. ^ In this equation, vbv_(0) expresses the capacity of the 

The values of R(j), Np, Nb, Kp, Kb and pic_rate are VB V buffer in the case where the delay time of the VBV 

supplied from the controller 24 (FIG. 5) provided in each 5 buffer reaches the maximum value xmax, and min{A,B} 

image coding device 2-i. The values of Xi, Xp and Xb are expresses a function selecting the smaller one of A and B. 

calculated by the complexity calculation circuit 31 in accor- That is, in this example, in the case where the maximum 

dance with the equations (1) to (3), as described above. value of the delay time of the VBV buffer is prescribed in 

In the equations (4) to (6), the bit quantity of what number advance by the operator or the like and where such a bit rate 

of allocation target pictures to which the estimate bit quan- aQ that the delay time of the VBV buffer exceeds the prescribed 

tity generated for the entire non-coded pictures corresponds maximum value is used, the controller 24 narrows the usable 

is found. range 0 f the VBV buffer (corresponding to the buffer 

For example, in the equation (4), NpXpiKp of the second memory 17 of FIG. 5), that is, equivalently reduces the 

term of the denominator of the first factor expresses the bit capacity of the VBV buffer, and controls the delay time so 

quantity of what number of I-pictures to which Np non- as not to exceed the maximum value . max imum value 

coded P-pictures in the GOP correspond, and NbXb/XiKb of Tmax is expressed by the following equation, 
the third term expresses the bit quantity of what number of 

I-pictures to which Nb non-coded B-pictures in the GOP Tmax=vbv_sizc(o)/bit_rate(o) (14) 
correspond. The first term, 1, expresses the number of 

I-pictures in the GOP. (The number of I-pictures in one GOP In this equation, vbv_size(0) expresses the maximum 

is constantly 1). Therefore, the first factor in the equation (4) 20 capacity of the VBV buffer (a predetermined value in the 

expresses the bit quantity per picture on the assumption that MPEG standard), and bit_rate(0) expresses the bit rate in 

all the remaining (N-j+1) pictures in the GOP are I-pictures. the case where the delay time of the VBV buffer reaches the 

N expresses the number of pictures included in the GOP. maximum value -cmax. 

Similarly, in the equation (5), NbKpXb/KbXp of the At step S3, the controller 24 compares the value of the 

second term of the denominator of the first factor expresses 25 occupancy quantity B*0+1) of the VBV buffer calculated at 

the bit quantity of what number of P-pictures to which Np step S2 and the value of the vbv_size(j+l). As a result of 

non-coded B-pictures in the GOP correspond. Therefore, the comparison, if B*(j+1) is equal to or greater than vbv__size 

first factor in the equation (5) expresses the bit quantity per 0+1), (that is, if the target bit quantity T(j) must be corrected 

picture on the assumption that all the remaining (N-j+1) because the delay time of the VBV buffer exceeds the value 

pictures in the GOP are P-pictures. 30 "rmax if the vbv_size(j+l) of the VBV buffer is used as it is,) 

Moreover, in the equation (6), NpKbXp/KpXb of the the processing goes to step S4 and the target bit quantity T(j) 

second term of the denominator of the first factor expresses calculated at step SI is corrected by the amount of difference 

the bit quantity of what number of B-pictures to which Np between B*(j+1) and vbv_size(j+l) in accordance with the 

non-coded P-pictures in the GOP correspond. Therefore, the following equation, 

first factor expresses the bit quantity per picture on the 35 



assumption that all the remaining (N-j+1) pictures in the 



TO)-T(j>B*(j+l)-vbv_sizc(j+l) (15) 



GOP are B-pictures. If it is determined at step S3 that B*0+1) is smaller than 

Fundamentally, the values of the first factors m the v bv_size(j+l), it does not enter the unusable range of the 

equations (4) to (6) are determined as the target bit quantities ^ y buffer Therefore, the processing of step S4 is skipped. 

Ti(j), Tp(j) and Tb(j) of I-picture, P-picture and B-picture. Next? al step S5> the picture q ^ encoded on the basis of 

(Hereinafter, if I-picture, P-picture and B-picture need not be tne target 5it quantities Tl Q )f Tp( j) and ^(j) calculated at 

discriminated, the target quantity is described simply as step s j or tne target bit qua ntities Ti(j), Tp(j) and Tb(j) 

TQ).) However, if the values found by. arithmetic operation corrected at step S4. Specifically, the quantizer scale code 

are too small, there is a risk that the VBV buffer of the image determination circuit 33 determines the quantizer scale code 
decoding device will overflow. Therefore, the value bit_ 45 Q1 corresponding to the target bit quantity Tl (Ti(j), Tp(j) 

rate(j)/(8xpic_rate) prescribed by the second factors in the or set by the target bit quantity circuit 32. The 

equations (4) to (6) is selected as the target bit quantity TQ). quantization circuit 15 quantizes the picture A) in accor- 

On the assumption that the data occupancy quantity of the dance ^ the quantize r scale code Ql. The processing in 

VBV buffer immediately before encoding the picture (j) as this case is as described above and therefore will not be 
the coding target is B*(j) and that the bit quantity of the same 50 described further in detail. 

value as the target bit quantity T(j) is generated by actual Up t0 this slep> pr0C essing for the j-th picture (j) in the 

coding of the picture 0), the occupancy quantity B*(j+1) of GOP is completed. At the following steps, processing for the 

the VBV buffer immediately before encoding the next Q +1)th picture in the GOp ^ carried out 

picture 0+1) is expressed by the following equation. At step At step S6j the controller 24 subtracts the bit quantity S(j) 

S2, the controller 24 calculates this occupancy quantity generated by coding the picture (j) rom the bit quantity R(j) 

B*(j+1) in accordance with the following equation. of the non -coded picture before coding the picture (j), in 

B'0'+i)-B"0> T 0>( t yi-V) xbit ~ rale (i +1 ) ( 12 ) accordance with the following equation, and thus finds the 

In this equation (12), t, expresses the timing at which the quantity RQ+1) allocated I to non-coded I pictures including 
picture (j) is read out from the VBV buffer, and t /+li 60 * he coding target picture 0+1). k .short, RO+1) expresses the 

expresses the timing at which the picture 0+1) is read out b Jf ■j""** obtamed b ? addm S ^ bl x l quantities allocated to 

from the VBV buffer. Bit_rate<j+1) expresses the bit rate » U tbc P iclures 1 V*** 0+1) 35 the C ° dmg Urget 10 

newly set with respect to the picture 0+1) and the subse- lhe last P icture (N) 10 the G0R 

quent pictures. RG + i)-RG)-S0) (16) 

In addition, at step S2, the controller 24 determines a 65 

usable range of the VBV buffer in accordance with the Al step S7, the controller 24 corrects the bit quantity 

following equation. RQ+ 1 ) calculated at step S6 by using the quantity of change 
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{vbv__size(j)-vbv_size(j+l)} of the usable range of the is similar to that of FIG. 9. On the other band, if the bit rate 

VBV buffer, in accordance with the following equation. is changed at the time point tl to the bit rate bit_rate(2), 

which is smaller than the threshold value bit_rate(0), the 

R0 + i)-Ra+i)+{vbv_si2e0>vbv_8izc0 + l)} (17) capacity of the yBV buffer is limited to vbv_size(2) 

The meaning of processing up to step S7 will now be 5 (^™axxbit_rate(2)). 

described further in detail with reference to FIGS. 8 to 13. Id ^ case where a rate control system on the assumption 

If the bit rate bit_rate(j) designated by the controller 3 is of a fixed bil rate such as ™ 5 ™ d a fixed ca P acit y °[ the 

equal to the bit rate bit_rate(0) (hereinafter referred to also buffcr » calculation of the usable range of the 

as a threshold value) of the case where the delay time of the VBV buffer g enerate s * problem as shown in FIG. 12. 

VBV buffer reaches the maximum value xmax, the control- 10 Specifically, in the case where the bit rate is changed from 

ler 24 controls the VBV buffer (buffer memory 17) as shown the value bit_rate(l) greater than the threshold value bit_ 

in FIG. 8. (The character "j" does not indicate the character rate G) t0 the value bit_rato(2) smaUer than the threshold 

"i" (for program Pi) in bit_rate#i of FIG. 4 but indicates the value bit_rate(0), the locus of data transition in-the VBV 

order of the picture. Both of these characters can be collec- buffer needs 10 be as indicated by a solid line in FIG. 12 so 

lively described as in bit_rate#(j).) As shown in FIG. 8, the 15 that the data volume shlfts ™ ih ™ the lmuted ran S e of the 

capacity of the VBV buffer sequentially increases at the bit ^ buffer However, in the TM5 rate control algorithm, 

rate bit_rate(0). At the point when the delay time xmax has since the target bit quantity is determined to shift in an area 

elapsed, the capacity of the VBV buffer becomes vbv_size close to the maximum value of the VBV buffer, limitation of 

(j). Then, image data stored in the VBV buffer is reduced lhe usable ran g e alone ^ cause transition of the VBV 

every time it is suitably read out and decoded. When image » buff <* * ™ unusable range, as indicated by a dotted line in 

data is newly written, the data quantity is increased. The ^ 

operation as described above is sequentially repeated. il caD be considered to increase the quantity of 

If the bit rate bit_jate(l) designated by the controller 3 is generated bits by stuffing by the quantity of generated bits of 

greater than the threshold value bit_rate(0), the controller the first I-picture, when the usable range of the VBV buffer 

24 controls the buffer memory 17 at the time of encoding 25 15 limited ' In this wa X» however, the quantity of generated 

processing of step S5 and delays the output of image data by blts of lhe first H^ture increases. Therefore, when the 

the time tl. This delay time xl is calculated in accordance remaining bit quantity R(j) in the GOP is updated in accor- 

wilh the following equation. dance with the equation (16) (that is, R(j+l)«R(j)-S(j)), the 

bit quantity R(j+1) allocated to the remaining non-coded 

xi«^max-T2 30 pictures becomes a very small value, and the locus of the 

• t . a.\ i\ o\ VBV buffer will return to the unusable upper range in FIG. 

^rmax-vbv__SLZc(0)/bit_rate(l) (18) & 

After this delay time xl, data is written into the VBV Thus, at step S3, the value of the buffer occupancy 

buffer at the bit rate bit__rate(l). At the point when the time quantity B*(j+1) calculated in accordance with the equation 

x2 has elapsed after the start of writing, the capacity of the 35 (12) and the value of the capacity vbv_size(2) of the VBV 

VBV buffer becomes vbv_size(l)«vbv__size(0). As is clear buffer calculated in accordance with the equation (13) are 

from comparison between FIG. 8 and FIG. 9, the maximum compared with each other. If B*(j+1) is greater than vbv_ 

delay time xmax of the VBV buffer is the same in both cases. size(2), the target bit quantity T(j) calculated at step SI is 

If the bit rate bit_rate(2) designated by the controller 3 is corrected at step S4 by the difference (B*(j+l)-vbv_size 

smaller than the threshold value bit_rate(0), the controller 40 (2)) as shown in the equation (15). As a result, the corrected 

24 controls the buffer memory 17 and sets (limits) the target bit quantity T(j) has a value smaller than the capacity 

capacity (usable range) of the buffer memory 17 to not more vbv_size(2) of the VBV buffer by the difference (B*(j+1)~ 

than vbv_size(2). This arithmetic operation is carried out at vbv_size(2)) as shown in FIG. 13, and the unusable range 

step S2 of FIG. 6. Specifically, the range exceeding the of the VBV buffer is prevented from being used. 

vbv_sizc(2), of the capacity vbv AJ _size(0) of the VBV 45 After the processing for limiting the usable range of the 

buffer, is not used in this example. As a result, at the point VBV buffer is carried out as described above, processing of 

when the delay time xmax has been elapsed, the capacity step S8 and subsequent steps of the flowchart of FIG. 7 

vbv_size of the VBV buffer becomes vbv_size(2) (=xmaxx continuing from FIG. 6 is carried out. In this case, process- 

bit_rate(2)). Therefore, in this case, too, the delay time of ing in the case where the bit rate is changed at a halfway 

the VBV buffer is xmax. In other words, the delay time of the 50 point in the GOP is carried out. 

VBV buffer is constant at xmax in any of the cases of FIGS. The target bit quantity setting circuit 32 determines at step 

8 to 10. S8 whether the picture (j+1) is the leading picture of the 

Thus, seamless changes of the bit rate can be carried out GOP or not. In short, it determines whether (j+l) is 1 or not. 

in a broad range and can be applied to a live broadcast If the picture (j+l) is not the leading picture of the GOP, the 

having a constant delay time in digital broadcasting. 55 processing goes to step S9 and the target bit quantity setting 

In FIG. 10, if data is written into the VBV buffer for a circuit 32 determines whether or not a change of the bit rate 

delay time x3 («vbv_size(0)/bit_rate(2)), the capacity of in that GOP is designated by the controller 3. If a change of 

the VBV buffer will become vbv__size(0). In this example, the bit rate is not designated, the processing goes to step S10 

however, since only the range not more than the capacity and the target bit quantity setting circuit 32 determines 

vbv_size(2) is used, the capacity does not actually reach 60 whether the processing target has reached the sequence end 

vbv_size(0). or not. If the sequence end has not been reached, the 

FIG. 11 shows the state of changes of the VBV buffer in processing returns to step SI and the subsequent processing 

the case where the bit rate is changed from bit rate(l) to is repeatedly carried out. If it is determined that the pro- 

bit_rate(2) at a halfway point. During the time period up to cessing target has reached the sequence end, the processing 

the time point tl, the value of the bit rate is bit rale(l), 65 ends. 

which is greater than the threshold value bit_rate(0). If it is determined at step S9 that a change of the bit rate 

Therefore, the state of changes of the VBV buffer in this case is designated, the target bit quantity setting circuit 32 goes 
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to step S12 and corrects the bit quantity R(j+1) corrected at The function of the correction value "e" will now be 

step S7, using a value obtained by multiplexing the number described. In the case where the bit quantity R(j+1) cor- 

of remaining pictures (N-j) of the GOP by the difference in rected by the equation (19) at step S12 is smaller than the 

bit quantity per picture (bit_rates(j+l)-bit_rates(j))/pic_ predetermined minimum value Rmin, if the bit rate of the 

rate, in accordance with the following equation. 5 next GOP is controlled while this R(j+l)<Rmin is left as it 

is, there is a risk that the VBV buffer will overflow. 

RO"+i)-{bit_ratcG+i)-bit_ratc(i)}x(N-i)/pic_ratc+RO+i) (19) a change of the bit rate at a halfway point in the 

« . .. A ... 4 . . . « « *#• . „ . GOP is designated. If R(j+1) is smaller than the minimum 

That b, if the b., rate is not changed at a halfway point in va]ue Rmjn * ^ k , he ^ jcture (N ., h jcmre) 

the GOP the bit quanWy R » gradually reduced from die ofthe oopisencoded, the initial value R2of the bitquantity 

mitial value Rl as encoding proceeds, as shown in FIG. 14. « r « u nr\n • j j u ,u j«<r « » j ,l 

t i-Ti- t>i ..... . ... . 4 ■ j R for the next GOP is reduced by the difference "e and the 

In FIG. 14, a solid hne indicates the case where it is assumed ... ... c 4 ^ rtT> . . ... . ... , , fri „ 

. . j . ... , ... bitquanUty for that GOP is set with an initial value of R2-e, 

that the respective pictures are encoded with the equal bit \ : „„„ <, , ™ e . «. . 

. * „ " . ... . , e as shown in FIG. 16. Thus, overflow of the VBV buffer is 

quantity. Actually, since the quantity of generated bits of , 

I-picture or P-picture is greater than that of B-picture, the bit Pre ,X above description, in each image coding device 2-i, 

quantity R changes as indicated by a dotted hne. ^ p . fc statisticall by | eding back 

On the other hand, if a change of the bit rate is required ^ lexft Q J f actu ^ Uy ^ data *, the 

rnp rf r „ ena ; ;f P1C T^ 0) ° h controUer 3 - However, the bit rate can also be controlled by 

GOP, the bit quantity R(i) allocated to non-coded pictures c , c . . , U.^, i - . . . ' 

r „ 1 . M . . . . , , , * . feed-forward control. FIG. 17 shows an exemplary structure 

following the picture fj) is corrected at step . SU as expressed 2Q sucfa case ^ structure rf aQ ^ 

by the equation (19). Specifically, though the bit quantity R j shown fa nG „ fc bas ^ f t(j ^ q{ ,* ^ 

allocated to the remaining non-coded pictures has been ... . . t , . . . ., . * 

„ , . . . „ . , r f_ . ... * , 0i multiplexing system 1 shown in FIG. 4 except that the 

controUed to be gradually reduced from the initial value Rl £ ^ J Di, instead of the global complexity Ci, is 

at the first bit rate bit rate(i+l), the bit quantity R(i+1) is , f. . c J *. J . * . / 7 , ' 

. j - .l • — c • _ /• 7\ outputted from each image codmg device 2-i to the control- 
corrected at the timing of the picture | Tt. ,l , rTu T ■ *i , ,u r 
~,. . » ■ • ■ it +u u* 25 ler 3. The other parts of the structure are similar to those of 
This corrected bit quantity RQ+1) is equal to the bit ^ r 

quantity Rfi+1) of the picture in the case where the * * . . , . . ... c 

^. <• f i «» . »'< , , . The coding dicnculty is an index indicating the quantity of 

pictures from the leading picture of the GOP are encoded at ... na „ arni °i 00 a ', t rtf iP t ^ ■ _ Q 

f. ... . ... i\ • i i bits generated as a result of coding processing. If the image 

the second bit rate bit rate(i+l) with an initial value of R2. t 4 . r ,. f . . . .f 

. • , /• i\ • . . of the coding target picture is complicated or highly 

In other words, m coding the picture n+1) as a picture at , .l- j- j4 i* • t_- l rr*i_ • 

... . . ! ^ Y* * • l j 30 dynamic, this coding difficulty is high. If the image of the 

a halfway point m the GOP, when the bit rate is changed J , t . . & . . / i j ♦u j- 

r *l a * . * *u . .« t^'t ?•* codmg target picture is simple or less dynamic, the coding 

from the first bit rate to the second bit rate, the bit quantity diffi ^ 1 

allocated to the non-coded pictures of the picture Q+l) and p ^ ^ ^ e s(ructure 

the subsequent pictures is corrected as if coding processing ^ ^ * » ^ 

had been carried out at the second bit rate from the leading „ . & , . ^ ^ . - v u & . ' 

icture C) of the GOP image coding devices 2-2 to 2-n have the same structure as 

kt * L cii jt *\~ . u » that of the image coding device 2-1 .) The basic structure is 

Next, the processing goes to step S13 and the target bit ... 4 . * ir> _ f. . ^ i . *. 

j » • i_ *u *7u u * similar that of FIG. 5. However, m the exemplary structure 

quantity setting circuit 32 determines whether or not the bit r mo 10 •* a/-> i i V • •* ii j 

n/- f\ * ^ * . en • 11 *u of FIG. 18, an mtra-AC calculation circuit 41 and a FIFO 

quantity R(j+1) corrected at step S12 is smaller than a /c . . - ' 4X A ~ . , . . t 

j * • j ■• i n • ir »u u * «■* (first in first out) 42 are provided between the scan conver- 

prcdetermmed minimum value Rmin. If the bit quantity _ v . . , , ' . r . .. , . . . 

„/. -x . , . ■ • i ii • 40 sion macroblock forming circuit 12 and the subtracter 13. 

Ru+1) is equal to or greater than the minimum value Rmin, A1 xjrn . & . . . . , ,. 

n V \ \. . „ „ . . T - ... Also, an ME residual calculation circuit 51 and a coding 

0 is set as the correction value "e , at step S14. If the bit * Umt # . - t M , „ . , , • 

t . t n/ . 1V . ii • • t r> • difficulty calculation circuit 52 are additionally provided in 

quantity RQ+1) is smaller than the minimum value Rmin, ^ e rate controller 23 

the difference (R(i+1)-Rmin) between the bit quantity R(j+ ^ . . Ar> . ' . . . . 1 . . . _ 

n ... >■ ' , < r, • • . «u ^ The intra-AC calculation circuit 41 receives the output of 

1) and the mmimum value Rmin is set as the correction Ae tU U1 . e . 

' ti „ , . o-i c t*u ■ i « « • , # 45 the scan conversion macroblock forming circuit 12, then 

value e , at step S15. This correction value e is used at , , . . . * . • « , . °. . . . . , 

en m. f r .u- .* i «» n u calculates intra-AC m I-picture, and outputs the calculated 

step Sll. The function of this correction value e will be . . A -. .r^ . . . . \ . M 

, F . , . mtra-AC to the codmg difficulty calculation circuit 52. The 
flE^cnnefi later 

* AA f , C1 . , C1 . intra-AC calculation circuit 41 also outputs image data 

After the processing 5 of step S14 or step SIS, the process- from conversion macroblock forming 

^eafedl carried 0 t subsec l uent P rocessm 8 1S 50 circuit 12 to the FIFO 42. The FIFO 42 delays the inputted 

Tfit is deteZncd U at step S8 that the coding target picture taa 8 e ^ f ta '» 't 351 e tim .^ «>rresponding to the time 

1X . ! ,. . ^ r . 6 • required for the target bit quantity settmg circuit 32 to set the 

(l+l) is the leading picture of the GOP, the processing goes t ... & , 7 , , . & , . , , , 

r i on j^. . . t_-. . ! ■ .7,-1 target bit quantity, and outputs the delayed image data to the 

to step Sll and the target bit quantity settmg circuit 32 subtracter 13 J * J & 

correct the bit quantity R(j + 1) in accordance with the 5J The ME residual calculation circuit 51 calculates an ME 

followmg equation. In short, the b. quantity R(l) alloca ed residual based Qn M£ residua , da , a ^ b te motion 

to non-coded picmres ,nc luding the lead.Dg p.cmre (1) of the detectio[) ^ and ou ^ residua , 

GOP and the subsequent pictures is calculated by the fol- . ^ , » M t, wr 

. t* to the coding difficulty calculation circuit 52. The ME 

1 " n ' residual is a value obtained by adding the absolute value or 

R(i>bU_ratc(i + a)xN/pic_rate+R(i+i)« (20) 60 lhe s q uare value of a motion prediction error to the entire 

picture. The ME residual data is data for finding the ME 

This bit_rate(j+l) expresses the new bit rate set with residual, 

respect to the picture (j+1), and RQ+1) expresses the result The coding difficulty calculation circuit 52 calculates the 

of arithmetic operation in accordance with the equation (16) coding difficulty Dl expressing the difficulty of coding of 

for the last picture (N) of the previous GOP. 65 the picture on the basis of the ME residual calculated by the 

After that, the processing returns to step S10 and the ME residual calculation circuit 51 and the intra-AC calcu- 

subsequent processing is repeatedly carried out. lated by the intra-AC calculation circuit 41. The coding 
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difficulty calculation circuit 52 transmits the coding diffi- processing of steps SI to S7 shown in FIG. 6. However, at 

culty Dl to the controller 3 and to the target bit quantity step S31, the target bit quantity T(j) of the picture (3) is 

setting circuit 32. In this exemplary structure, since the calculated in accordance with the following equation, 

coding difficulty Dl calculated by the coding difficulty instead of the equations (4) to (6). In the following equation 

calculation circuit 52 is transmitted to the controller 3, the 5 (23), subscripts "i", "p" *°d " D " corresponding to the picture 

global complexity CI arithmetically found by the complex- types are omitted, 
ity calculation circuit 31 is not supplied to the controller 3. 

The other parts of the structure of the image coding device 
2-1 shown in FIG. 18 is similar to those of FIG. 5, 

The operation of the image coding device 2-1 of FIG. 18, 10 T ^ = mBXi 
mainly of the structure different from that of FIG. 5, will 
now be described. The intra-AC calculation circuit 41 cal- 
culates intra-AC from the image data outputted from the 

scan conversion raacroblock forming circuit 12. The intra- In this equation, T(j) expresses the target bit quantity of 

AC means the absolute value sum of the difference between is the processing target picture (j), and R'(j) expresses the bit 

the pixel value of each pixel in a macroblock of 8x8 pixels quantity allocated to fixture L pictures from the processing 

and the average value of the pixel values in the macroblock target picture (j). Dj expresses the coding difficulty of the 

in I-picture. The intra-AC is expressed by the following picture (j). That is, in accordance with the above equation, 

equation. the target bit quantity T(j) of the picture (j) is found by 

20 weighting the bit quantity R'(j) allocated to the pre-read L 

imra_^C2|fcurr(x,y)-0Efcirr)/N| (21) pictures by the ratio of the coding difficulty Dj of that picture 

* . . . - A ^ .. , c and the sum of the coding difficulty Dj of pre-read N 

In this equation, Intra-AC expresses intra-AC, and fcurr . to J J r 

(x,y) expresses the pixel value of each pixel in the macrob- ^Th^rocessinp of stens S32 to S35 is similar to the 

lock. Zfcurnx,y) expresses the sum of the pixel values in the _ f r . m . £* n-i^ a j .l c ■« 

. i a j xt *u u * • i • *u 25 processing of steps S2 to S5 of FIG. 6 and therefore will not 

macroblock, and N expresses the number of pixels m the f_ , Jf , - J *T . , , A4 t . . . 

, . . ' v ... ; , 4l _ • j » be described further in detail. At step S36, the bit quantity 

macroblock Z egresses the sum with respect to the tndi- ^ ^ ^ L ^ ^ ^ 4 cessjn > 

vidualpaelsm the macrob ock target picture 0+1) is calculated in accordance with the 

In findmg the motion vector, the motion detection circuit ^J (24) ins(ead of the ion 

21 outputs the absolute value sum (or square sun) of the 3Q 6 ^ v " ^ v ' 

difference in pixel value between macroblocks having the R(j+i>R'(j)-s(j)+FG+L) (24) 

minimum value, as the ME residual data to the ME residual , ,_ A . „,,.. . .. 

calculation circuit 51. The ME residual calculation circuit 51 „ ln th ^ e< l u u a,I0 A n ( 24 >> R G) jesses the bit quantity 

adds the ME residual data from the motion detection circuit a,located lo u the foture L Pictures from the picture (,). S(j) 

21 to the entire picture and calculates the ME residual. That „ **?™*es the quantity of generated bus of the picture Q. 

is, arithmetic operation is carried out by the ME residual 35 F P+L) expresses ; the predicUve bit quantity allocated to the 

calculation circuit 51 in accordance with the following P^frVutol^^P^bmtotMfrty 

eauation initial value of R'(j) is expressed by the following 

equation in accordance with the bit quantity of the pre-read 

ME_rcside-Z|fj(x,y)-f|-l(x,y)| (22) L pictures. 



40 



In the above equation, ME reside expresses the ME 



R'(l>bil_rate(l)xL/pic_rate (25) 



residual, and fj(x, y) and fj-l(x,y) express the pixel values In me equation (24), F(j+L) expresses the bit quantity 

of the respective macroblocks. 2 expresses the sum with corresponding to the picture type of the pictures (j+L) as the 

respect to the individual pixels in the macroblock. L_th future picture from the picture 0+1) and is prescribed, 

The coding difficulty calculation circuit 52 calculates the 45 f or example, by the following equations. In the equation 

coding difficulty on the basis of the intra-AC supplied from (24), subscripts "i", "p" and "b" corresponding to the picture 

the intra-AC calculation circuit 41 and the ME residual t y pe s j n me following equations (26) to (28) are omitted, 
supplied from the ME residual calculation circuit 51. The 

coding difficulty expresses the difficulty of coding of the C(y + Z.) (26) 

picture. In other words, it is the ratio of data quantity 50 

necessary for maintaining the same picture quality in cod- 1 + ~x~K~ B + X\K b 
ing. The intra-AC expresses complexity of the pattern, and 

the ME residual expresses quickness of motion of the image F q + q = - ^ 27 ^ 

and complexity of the pattern. Since these intra-AC and ME N + N *> K P X i> 

residual have strong correlation with the coding difficulty, 55 KbX p 

these are used as variables. For example, the coding diffi- C( ' + JL) (28) 

culty Dl is calculated by the coding difficulty calculation F b y + L)= N K ^ x 

circuit 52 using a linear function. Nb + x K ^ 

Thus, the coding difficulty with high precision is calcu- 
lated on the basis of the pre-read statistical quantity (intra- 60 

AC). The controller 3 determines the target bit rate bit In the above equations, G expresses the bit quantity 

rate#i on the basis of the coding difficulty Di and outputs the allocated to the future non-coded pictures of the picture 

determined bit rate to the image coding device 2-i. (j+L) and the subsequent pictures in the GOP including the 

The operation of the target bit quantity setting circuit 32 picture (j+L), and corresponds to the bit quantity R in the 

and the controller 24 of FIG. 18 will now be described with 65 feedback rate control system shown in FIGS. 4 and 5. This 

reference to the flowcharts of FIGS. 19 and 20. The pro- bit quantity G is also updated in accordance with the 

cessing of steps S31 to S37 is basically similar to the following equation, at step S36. 
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G(j+L+i)-G(j+L)-FO+L) (29) second bit rate. Specifically, as understood from the equation 

. . ... . (31), the bit quantity R' is corrected using the value obtained 

F(j+L) u, the equation (29) is expressed by the equation b mu i tiplying ^ differ in bit quan ,i,y per picture by 

?£x he P ° Ddm8 P1C,Ure tyPe ' fr0m am ° Dg ,he eqUaU0DS *e number of L pictures for which the coding difficulty is 

(26)to(28). s ead 

Since the bit quantity R' expresses the bit quantity of the Qn ^ olhef hand ^ bi , tf Q aUocated tQ ^ 

L pictures to be coded from now, basically, the bit quantity oon<oded picIures i^^g me target picture m , he 

R has a constant value as indicated by a solid line in FIG. GOp fc ch d ffom , he va , ue G(j+1) in ^ case where 

21 regardless of the proceeding status of encoding Actually, encodi js carried ou , a , , he bi , ra , e bit _ rate(1) t0 the value 

however, since the bit quantity changes for each picture JQ G(j+1) fa , he case where encodin k carrfed ou , ^ ^ 

type, the value vanes around the value ind.cated by the solid ^ va , ue f(om ^ as shown m f, g 24 

line, as indicated by a broken line in FIG. 21. ^ ^ similar tQ , be ^ of , he bj( Ut R wbich ^ 

On the contrary, the bit quantity G is the bit quantity described ^ reference lo FIG 15 In short> tbe bil tit 

allocated to the non^oded pictures in the GOP. Therefore, G M be correcled using the va i ue obtained by multiplying 

the value of the bit quantity G is gradually reduced along J$ , he difEerence in bit til icture b the number of 

with the proceeding of encoding and is reset at the beginning „ aa ^ soaea pictures (N _j) m the G0P . 

of the GOP, as shown in FIG. 22, similarly to the bit quantity Next> me 

processing goes to step S42 and the target bit 

™ lhe teedba <* rate control. quantity setting circuit 32 determines whether or not the bit 

Next, at step S37,updaung processing o^ the bit quantity lit G(j+1) t0 lhc lson<odcd pictures of the 

RO+1) I* earned out in accordance with the Mowing 2Q icturc Q+1) and lhe su5sequent ictures ^ me G0P is 

equation (30), instead of the equation (17) at step S7 of FIG. smaUer ^ a minimum value Gmin If the bit quamily 

G(j+1) is equal to or greater than the minimum value Gmin, 

R-0 + i)-R 1 0 + i)+{vbv_siz C 0>vbv_sizcO + i)} (30) 0 is set as the correction value "e", at step S43. 

If the bit quantity G(j+1) allocated to the non-coded 

The above-described processing of steps S31 to S37 is the 25 pictures of the picture (j+1) and the subsequent pictures is 

processing carried out for limiting the usable range of the smaller than the minimum value Gmin, the difference (G(j+ 

VBV buffer, as described in the example of feedback rate 1)-Gmin) between the bit quantity G(j+1) and the minimum 

control. value Gmin is set as the correction value "e", at step S44. 

Next, the processing goes to step S38 and the target bit This processing is similar to the processing of steps S13 to 

quantity setting circuit 32 determines whether the picture 30 S15 of FIG. 7. This correction value "e" is used in the 

(j+1) is the leading picture of the GOP or not. If the picture processing at step S46 or S47 as will be later described. 

(j+1) is not the leading picture of the GOP, the processing If it is determined at step S38 that the picture (j+1) as the 

goes to step S39 and it is determined whether a change of the coding target is the leading picture of the GOP (that is, (j+1) 

bit rate at a halfway point in the GOP is designated or not. is (1)), the processing goes to step S45 and the target bit 

If a change of the bit rate is not designated, the processing 35 quantity setting circuit 32 determines whether a change of 

goes to step S40 and it is determined whether the encoding the bit rate is designated or not. 

processing has reached the sequence end or not. If the The presence or absence of a change of bit rate is 

sequence end has not been reached, the processing returns to determined here. Meanwhile, if it is determined at step S8 of 

stepS31 and the subsequent processing is repeatedly carried FIG. 7 that the picture 0+1) is the leading picture of the 

out. If it is determined at step S40 that the processing has 40 GOP, bit rate change processing is not carried out. In the 

reached the sequence end, the processing ends. processing of FIG. 7, since the same equation (20) is used at 

If it is determined at step S39 that a change of the bit rate step Sll regardless of whether the picture (j+1) is the 

at a halfway point in the GOP is designated, the processing leading picture of the GOP or not, determination of a change 

goes to step S41 and the target bit quantity setting circuit 32 of the bit rate is not necessary. On the other hand, in the 

corrects the bit quantity R'(j+1) and the bit quantity G(j+1) 45 processing of the flowchart of FIG. 20, even when the 

in accordance with the following equation. picture (j+1) is the leading picture of the GOP, processing 

differs depending on the presence or absence of a change of 

R'G>i)-{bit rate(j + i)-bii_rates)}xi7pic_rat e 0>R'O>i) (31) the bit rate . Therefore, the determination processing of step 

GG + l)^bit^at eS a + l)-bit_rat C )}x(N-j)/pic_ratc + G( J +l) (32) S4 $ is ^erted. 

50 Specifically, if it is determined at step S45 that a change 

In the above equations, bit__(j) expresses the first bit rate of the bit rate is not designated, the target bit quantity setting 

designated in coding the pictures up to the picture (j), and circuit 32 calculates the bit quantity G(l) allocated to the 

bit_rate(j+l) expresses the second bit rale designated in non-coded pictures including the first picture of the GOP, in 

coding the pictures from the picture Q+l). L expresses the accordance with the following equation at step S46. 
number of pictures for which the coding difficulty is calcu- 55 

lated prior to coding processing (that is, the number of G(i)=bit_ratcO'+i)xN/pic_rate+GG+i)+c (33) 

pictures for which the coding difficulty is pre-read). N . , . , nMm , , _ , , . 

expresses the number of pictures included in the GOP. . ' flt 15 *tennined at step S45 that a change of the bit rate 

In the case where the bit rate is thus changed from the first » designated, the processing goes to step S47 and the target 

bit rate to the second bit rate at a halfway point in the GOP, 60 b ]\ Ktting «raut 32 updates the bit quantity R'(l) 

the bit quantity R' aUocated to the predetermined number (L) aUocated to the L-th non-coded picture from the first picture 

of pictures is corrected from the value Rl corresponding to « of ' he , G0P and quantity G(l) aUocated to the 

the first bit rate to the value R2 corresponding to the second non-coded pictures including the first picture (1) of the GOP, 

bit rate, as shown in FIG. 23. In short, the bit quantity R' m accordance with the foUowmg equations. 

aUocated to the non-coded pictures up to the L future 65 R ^HbU_ n t e (j + l)-ba_»tefl)}xUl»c_«ie + Rfl + l) (34) 
pictures including the coding target picture is corrected as if 

coding processing had been carried out at the newly set G(i)=bit_raie(j+i)xN/pic_n>ie+GO'+l)+c (35) 
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In the above equations, bit rate(j) is the bit rate corre- Thus, a threshold value biuate^) greater than the 

sponding to the picture (j), and bit rate(j+l) is the bit rate threshold value bit_rate(0) and a threshold value bit_rate 

corresponding to the picture (j+1). (0 L ) smaller than the threshold value bit_rate(0) are set, as 

As is clear from comparison between the processing of shown in FIG. 28. When the value of the bit rate bit_rate 

step S46 and the processing of step S47, the processing of 5 becomes smaller than the threshold value bit.rate^c), the 

step S47 includes updating processing of the bit quantity range of the ygy buffer ^ gradually restricted until 

R'(l) in addition to the processing of the bit quantity G(l). the bit rale reaches lhe threshold value bit rate(0, ). When the 

Hie function of the correction value «e" is similar to the bit fate smaUer than the threshold vaJue bit fate 

ftmction explained with reference to FIG. 16 As shown in {Q ) me M f ^ ^ buffef caQ be ab u 

FIG. 25, if the value of"e" is not 0 immediately after the last 1rt \J:: -<~a « ;« rt f ->n i„ iMc ^ t\,~ SL« 

~r^<n • j j i ^ .i. u c .i. io restricted as m the case or MO. 27. In this case, the nrst 

picture of the GOP is coded along with the change of the bit - . t . . ... - 

quantity G, the initial value R2 of the bit quantiiy G at the ^ h on n f h ht S,de J"^? T « If In^r i 

time of coding the next GOP is adjusted to a value smaller ^ ^ m the equation (13) at step S2 of Ad FIG. 6 is 

by the value of "e" tmaxxbit rate(j+l) when the bit rate is not higher than bit 

After the processing of steps S43, S44, S46 and S47, the rate (°J- However, when the bit rate has a value between 

processing goes to step S40 and the subsequent processing 15 bit_rate(O z ) and bit^ratefO^), the first factor may be 

is repeatedly carried out. changed to the following formula. 

In both of the above-described embodiments of feedback 

bit rate control and feed-forward bit rate control, the usable {(vbv_ 5 izc(o)-vbv_ s iz C (oj)xbit_iate 

range of the VBV buffer is limited. However, there may be +v bv_size(OJxbU ra tc( 0t/ ) 

some problems in consideration of the picture quality. 20 

Specifically, it is assumed that a bit rate of 3 Mbps is set in -vbv_size(0)xvbv_size(o L )} 
the first GOP while a bit rate of 1 .5 Mbps is set in the second 

GOP, and that a bit rate of 3 Mbps is set again in the third /{bit_rate(0 £/ )-bU_nite(O i ,)} (36) 
GOP, as shown in FIG. 26. At this point, if the capacity of 

the VBV buffer is 1.8 Mbits and the threshold value bit 25 Meanwhile, vbv_size((y is expressed by the following 

rate(O) is 3.0 Mbps, the delay time xmax is xmax=1.8/3.0= equation. 
0.6 (sec). 

At this point, the initial value of the bit quantity R vbv_si2c(0,)=vbv_si2c(0)xbit_Tatc(0 L )/bit_ratc(0) (37) 

allocated to non-coded pictures in the GOP applied to the , Q ^ feed . forward bit rate control t the [{ of 

TM5 bit rate control algorithm in each GOP is found as ff n calculated in accordance with 

follows from the formula of bit_ratexN/pic_rate. It is . . . / 1 r __ _ 

assumed that the number of GOPsN is 15 and thatpic_rate the amhmetic operation of step S32 of FIG. 19. 

^ 20 Although the intra -AC calculation circuit 41 of FIG. 18 is 

Specifically, in the first GOP, the initial value of the bit ada P ted for calculating intra-AC, it may be adapted for 

quantity R allocated to the non-coded pictures is 1.5 (=3.0x calculating flatness instead of intra-AC. The flatness is data 

15/30) Mbits. In the next GOP, the initial value is 0.75 35 indicating spatial flatness of the image. In this case, a DCT 

(=1.5x15/30). However, while the VBV buffer capacity block of8x8 pixels is divided into subb locks each consisting 

vbv_size (1) (of the previous GOP) before being corrected of 2x2 pixels. Then, the difference between pixel data (pixel 

by the difference (vbv__(l)-vbv_size(2)) of the capacity of values) located on the diagonal in each subblock is 

the VBV buffer in accordance with the equation (17) at step calculated, and the smaller value of absolute values of 

S7 of FIG. 6 is 1.8 (-a;maxxbit_rate(l)»0. 6x3.0), the VBV 40 difference is selected. The selected differential value is 

buffer capacity vbv_size(2) in the second GOP is 0.9 compared with a predetermined threshold, and the total 

(=rmaxxbitrate(2)=0.6xl.5). Consequently, the initial value number of sunblocks having the differential value smaller 

R is 1.65 (=0.75+(l .8-0.9)) Mbits. than the threshold value is found as the flatness for each 

In the third GOP, the initial value is 1.5 (=3.0x15/30). picture. 

However, while the capacity vbv_size(2) of the VBV buffer 45 The value of flatness becomes smaller as the pattern of the 

before changing is 0.9, the capacity vbv_size(3) in this GOP image is spatially more complicated. The value of flatness 

is 1.8. Therefore, the initial value R is 0.6 (=1.5 +(0.9-1. 8)) becomes greater as the pattern of the image is spatially 

Mbits. flatter. This flatness has strong negative correlation with the 

In the second GOP, though the bit rate is set at a small coding difficulty Di. Therefore, the coding difficulty Dj of a 

value of 1.5 Mbps since the picture has a pattern easy to 50 picture to be I-picture before compression coding can be 

encode, the initial value of the bit quantity R is set at a larger found from the flatness and the target bit quantity T(j) for 

value of 1.65. In the third GOP, though the bit rate is set at I-picture can be found from the flatness, 

a large value of 3.0 Mbps since the picture has a pattern As described above, the bit rate can be changed at a 

difficult to encode, the initial value of the bit quantity R is halfway point in the GOP while the rate control method for 

set at a smaller value of 0.6 Mbps. That is, a reversal 55 a fixed bit rate is used. Therefore, the codes of the pattern 

phenomenon is generated such that the initial value of the bit quickly meet changes of the difficulty so as to change the bit 

quantity R of the second GOP is large while the initial value rate. As a result, even when the phases of GOP of individual 

of the bit quantity R of the last GOP is very small. programs arc not synchronized, the transmission capacity 

This reversal phenomenon is caused by the fact that the can be effectively used and the overall picture quality can be 

usable range of the capacity vbv_size of the VBV buffer is 60 improved. 

abruptly restricted when the value of the bit rate bit_rate Also, by using the rate control method used for encoding 

becomes smaller than the threshold value bit_rate(0), as at a fixed bit rate, rate control that can prevent underflow or 

shown in FIG. 27. In FIG. 27, the horizontal axis represents overflow of the VBV buffer (or the buffer of the decoder) can 

the bit rate bit rate and the vertical axis represents the be extended to statistical multiplexing. 

capacity vbv_size of the VBV buffer. In FIG. 27, a shaded 65 This invention is not limited to statistical multiplexing, 

area represents an area where the use of the VBV buffer is and can be applied to the case where the bit rate is seam- 

restricted. lessly changed while the rate control method for fixed-rate 
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coding is used in encoding data to be stored into a recording According to the present invention, in the case where the 

medium such has a hard disk. Thus, it is possible to change designated bit rate is changed from the first bit rate to the 

the bit rate in accordance with the picture pattern and hence second bit rate at a halfway point in the GOP, the anticipated 

to realize predetermined picture quality and saving of the bit quantity allocated to non-coded pictures is corrected so 

capacity of the storage medium. 5 that the locus of change of the anticipated bit quantity 

In the above-described embodiment, the target bit quan- allocated to non-coded pictures becomes the locus at the 

tily is calculated on the GOP basis by using the TM5 ^me when each picture is coded at the second bit rate, and 

algorithm. However, this invention is not limited to the me t t bit lit allocaled tQ the codi t t icture 

embodiment and can be broadly apphed to the case where b calculaled on thc basis of the coated bit quantity, 

the target bit quantity is calculated by calculating the bit According t0 the present iDven tion, in the case where the 

quantity using a target transmission rate on the basis of a . . , j u A c lu c « u-. . * .u 

predetermined number of pictures as a unit from among designated bit rate is changed torn the first bit rate to the 

pictures to be coded second bit rate at a halfway point in the GOP, the bit quantity 

Also, in the above-described embodiment, the bit rate is aIloca r ted non - co i ded P ictures * corrected from the bit quan- 

changed on the picture basis by correcting the bit quantity R m y of non-coded pictures based on the first bit rate to the bit 

allocated to the remaining non-coded pictures. However, 15 quantity of non-coded pictures based on the second bit rate, 

this invention is not limited to the embodiment and can be and the tar S et bit quantity allocated to the coding target 

broadly applied to the case where the bit rate is changed on picture is calculated on the basis of the corrected bit quantity 

the GOP basis. of non-coded pictures. 

Moreover, in the above-described embodiment, each pro- According to the present invention, in the case where the 

gram is coded and transmitted in accordance with the MPEG 20 designated bit rate is changed from the first bit rate to the 

system. However, this invention is not limited to the second bit rate, the target bit quantity allocated to the coding 

embodiment and can be broadly applied to the case where target picture is corrected on the basis of the difference 

various programs are coded and transmitted by using various between the first bit rate and the second bit rate, 

coding systems. According to the present invention, in the case where the 

In the present specification, the system represents an 25 designated bit rate is changed from the first bit rate to the 

entire device constituted by a plurality of devices and units. second bit rate at a halfway point in the GOP, the target bit 

As providing media for providing a computer program for quantity is corrected from the target bit quantity correspond- 

carving out processing as described above to the user, ing to the first bit rate to the target bit quantity corresponding 

communication media such as a network and a satellite as to the second bit rate. 

well as recording media such as a magnetic disk, a CD-ROM 30 According to the present invention, in the case where the 

and a solid state memory can be used. designated bit rate is changed from the first bit rate to the 

As described above, according to the present invention, second bit rate at a halfway point in the GOP, the bit quantity 

when the designated bit rate is changed from the first bit rate of non-coded pictures is corrected so that the locus of change 

to the second bit rate, the target bit quantity allocated to the of the bit quantity of non-coded pictures becomes the locus 

coding target picture is corrected on the basis of the differ- 35 at the time when each picture is coded at the second bit rate 

ence between the first bit rate and the second bit rate. from the leading picture of the GOP, and the target bit 

According to the present invention, in the case where the quantity allocated to the coding target picture is calculated 

designated bit rate is changed from the first bit rate to the on the basis of the corrected bit quantity of non-coded 

second bit rate at a halfway point in the GOP, the target bit pictures. 

quantity is corrected from the target bit quantity correspond- 40 According to the present invention, in the case where the 

ing to the first bit rate to the target bit quantity corresponding designated bit rate is changed from the first bit rate to the 

to the second bit rate. second bit rate at a halfway point in the GOP, the bit quantity 

According to the present invention, in the case where the of non-coded pictures is corrected from the bit quantity of 

designated bit rate is changed from the first bit rate to the non-coded pictures based on the first bit rate to the bit 

second bit rate at a halfway point in the GOP, the bit quantity 45 quantity of non-coded pictures based on the second bit rate, 

of non-coded pictures is corrected so that the locus of change and the target bit quantity allocated to the coding target 

of the bit quantity of non-coded pictures becomes the locus picture is calculated on the basis of the corrected bit quantity 

at the time when each picture is coded at the second bit rate of non-coded pictures. 

from the leading picture of the GOP, and the target bit According to the present invention, in the case where the 
quantity allocated to the coding target picture is calculated 50 designated bit rate is changed from the first bit rate to the 
on the basis of the corrected bit quantity of non-coded second bit rate at a halfway point in the GOP, the target bit 
pictures. quantity is corrected from the target bit quantity correspond- 
According to the present invention, in the case where the ing to the first bit rate to the target bit quantity corresponding 
designated bit rate is changed from the first bit rate to the to the second bit rate. 

second bit rate at a halfway point in the GOP, the bit quantity 55 According to the present invention, in the case where the 

of non-coded pictures is corrected from the bit quantity of designated bit rate is changed from the first bit rate to the 

non-coded pictures based on the first bit rate to the bit second bit rate at a halfway point in the GOP, the anticipated 

quantity of non-coded pictures based on the second bit rate, bit quantity allocated to non-coded pictures is corrected so 

and the target bit quantity allocated to the coding target that the locus of change of the anticipated bit quantity 

picture is calculated on the basis of the corrected bit quantity 60 allocated to non-coded pictures becomes the locus at the 

of non-coded pictures. time when each picture is coded at the second bit rate, and 

According to the present invention, in the case where the the target bit quantity allocated to the coding target picture 

designated bit rate is changed from the first bit rate to the is calculated on the basis of the corrected bit quantity, 

second bit rate at a halfway point in the GOP, the target bit According to the present invention, in the case where the 

quantity is corrected from the target bit quantity correspond- 65 designated bit rate is changed from the first bit rate to the 

ing to the first bit rate to the target bit quantity corresponding second bit rate at a halfway point in the GOP, the bit quantity 

to the second bit rate. allocated non-coded pictures is corrected from the bit quan- 
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tity of non-coded pictures based on the first bit rate to the bit 
quantity of -non-coded pictures based on the second bit rate, 
and the target bit quantity allocated to the coding target 
picture is calculated on the basis of the corrected bit quantity 
of non-coded pictures. 

Thus, in any case, deterioration in transmission efficiency 
can be restrained even when there is discrepancy between 
phases of GOP at the time of statistical multiplexing of 
image data. 

Description of Numerals 

1 image multiplexing system; 2-1 to 2-n image coding 
device; 3 controller; 4 multiplexer; 11 picture rearrangement 
circuit; 12 scan conversion macroblock forming circuit; 13 
subtracter; 14 dct circuit; 15 quantization circuit; 16 
variable-th coding circuit; 17 buffer memory; 18 inverse 
quantization circuit; 19 inverse circuit; 20 adder; 21 motion 
detection circuit; 22 motion compensation circuit; rate con- 
troller; 24 controller; 31 complexity calculation circuit; 32 
target bit quantity setting circuit; 33 quantizer scale code 
determination circuit 

What is claimed is: 

1. A coding device for coding video data on the basis of 
a designated bit rate, the device comprising: 

control means for calculating a target bit quantity allo- 
cated to each picture included in a GOP on the basis of 
the designated bit rate; and 

coding means for coding a coding target picture on the 
basis of the target bit quantity controlled by the control 
means, 

the control means correcting the target bit quantity allo- 
cated to the coding target picture on the basis of the 
difference between a first bit rate and a second bit rate 
when the designated bit rate is changed from the first bit 
rate to the second bit rate in the case where coding 
processing of the coding target picture is carried out by 
the coding means. 

2. The coding device as claimed in claim 1, wherein the 
control means finds the target bit quantity allocated to the 
coding target picture by distributing a bit quantity allocated 
to non-coded pictures that have not been coded in the target 
GOP in accordance with the picture type of the coding target 
picture. 

3. The coding device as claimed in claim 2, wherein the 
control means corrects the bit quantity of non-coded pictures 
in accordance with the difference between the first bit rate 
and the second bit rate, and calculates the target bit quantity 
of the coding target picture on the basis of the corrected bit 
quantity of non-coded pictures. 

4. The coding device as claimed in claim 2, wherein the 
control means corrects the bit quantity of non-coded pictures 
by using a value obtained by multiplying the difference 
between a bit quantity per picture at the first bit rate and a 
bit quantity per picture at the second bit rate by the number 
of non-coded pictures, and 

calculates the target bit quantity of the coding target 
picture on the basis of the corrected bit quantity of 
non-coded pictures. 

5. The coding device as claimed in claim 4, wherein an 
algorithm for calculating the target bit quantity of the coding 
target picture is a feedback-type arithmetic algorithm for 
calculating global complexity indicating complexity of a 
screen on the basis of the quantity of generated bits gener- 
ated as a result of coding processing of each picture by the 
coding means, and calculating the target bit quantity of the 
coding target picture on the basis of the global complexity 
and the bit quantity of non-coded pictures. 



6. The coding device as claimed in claim 4, wherein in 
coding pictures up to a picture immediately before the 
coding target picture at the first bit rate and coding pictures 
from the coding target picture at the second bit rate, the 
control means finds the bit quantity of non-coded pictures at 
and after the coding target picture by subtracting the quantity 
of generated bits generated by coding processing of the 
picture immediately before the coding target picture from 
the bit quantity allocated to the non-coded pictures at and 
after the picture immediately before the coding target pic- 
ture. 

7. The coding device as claimed in claim 6, wherein in the 
case where a leading picture of a GOP next to the target GOP 
is coded after coding pictures up to the picture immediately 
before the coding target picture at the first bit rate and coding 
pictures from the coding target picture at the second bit rate, 
the control means corrects the bit quantity allocated to 
non-coded pictures of the next GOP by using a correction 
value generated as a result of coding processing of the target 

20 GOP. 

8. The coding device as claimed in claim 1, wherein in 
coding a coding target picture (j+l) as a (j-i-l)th picture in the 
GOP, a bit quantity R(j+1) allocated to non-coded pictures 
including the coding target picture (j+l) in the target GOP is 
calculated in accordance with the following equation, 
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RG+1)-R(j)-S(j) 



and 



wherein a target bit quantity allocated to the coding target 
picture (j+l) is calculated on the basis of the bit 
quantity R(j+1) allocated to the non-coded pictures. 

9. The coding device as claimed in claim 8, wherein in the 
case where the coding target picture (j+l) is the first picture 
of the GOP, the bit quantity R(j+1) of the non-coded pictures 
at and after the coding target picture (j+l) in the GOP 
including the coding target picture (j+l) is calculated in 
accordance with the following equation, 

R(j+l)-bit_rateO"+l)xN/pic_rate+R(j+l)+€ 

where bit_rate expresses the bit rate designated to the 
target GOP including the picture (j+l), 

N expresses the number of pictures included in the GOP, 

pic_rate expresses the frame rate, 

R(j+1) expresses a value obtained by subtracting the bit 
quantity generated by coding processing of the picture 
(j) from the bit quantity R(j) of the non-coded pictures 
at and after the picture (j) in the GOP including the 
picture (j) preceding the coding target picture (j+l)> a °d 

e expresses the correction bit quantity supplied to the 
GOP next to the GOP including the coding target 
picture (j+l). 

10. The coding device as claimed in claim 8, wherein in 
the case where the coding target picture (j+l) is a picture at 
a halfway point in the target GOP, and 

where pictures up to the picture (j) preceding the coding 
target picture are coded at the first bit rate and pictures 
from the coding target picture (j+l) are coded at the 
second bit rate, the bit quantity of the non-coded 
pictures at and after the picture (j+l) in the GOP 
including the coding target picture (j+l) is calculated in 
accordance with the following equation, 

R(j+l)-(bit_raleG+l)-bU_ralcO'))x(N-j)/pic_rate+R(j+l) 

where bit rateQ) expresses the first bit rate, 
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bit__rate(j+l) expresses the second bit rate, 14. The coding device as claimed in claim 12, wherein the 

N expresses the number of pictures included in the GOP, control means corrects the bit quantity of the predetermined 

• Mto ovmo ™ f,„™ „ t „ number of non-coded pictures by using a value obtained by 

pic_rate expresses the frame rate, and u . , . . . , r 4 . . * 

*V r . ; multiplymg the difference between a bit quantity per picture 

R(,+l) expresses a value obtained by subtracting the bit s at the ^ bit rate and a bit quanti(y per picture at ^ 

quantity generated by coding processing of the picture bit rate by the pre determined number of non-coded pictures, 

(j) from the bit quantity R(j) of the non-coded pictures and 

at and after the picture (j) in the GOP including the Miles ^ targeI bit quamity of a* coding targel 

picture 0) precedmg the coding target picture 0+1). picture on , he basis of lhe corrected bil quantil of , he 

11. The coding device as claimed in claim 10, wherein the JQ predetermilled number of Doa<oded pictures, 
target bit quantity J(j+1) allocated to the coding target 15 _ ^ ^ device 

as claimed in claim 13, wherein 

piclure 0+1) is calculated in accoidance wuh the following evety Ume , picture ^ coded( ^ cM means flnds the bit 

equa ions, quantity allocated to non-coded pictures up to a picture 

nO+D-max (RG + i)/(i + N P Xp/XiKp + NbXb/XiKb), whicb is al f ad ° f lhe target picture by a predeter- 

15 muied number of pictures, on the basis of a bit quantity 

bit_rate/8xpic_rate) generated as a result of coding processing of a picture 

•w r *\ r^r ^„ x , . „ . , immediately before the coding target picture and an antici- 

Tp0+l)-max (RG+l)/(Np+NbKpWKbXp), bit_ratc/8xpic_rate) . f. - 4 ju-. r*L u- u • u j 

pated quantity of generated bits of the picture which is ahead 

TbQ(+i)=max (R(j+i)/CNb+NpKbXp/KpXb), bit_raic/8xpic_rau5) of the coding target picture by the predetermined number of 

20 pictures. 

where Ti(j+1) expresses the target bit quantity in the case 16- The coding device as claimed in claim 15, wherein the 

where the coding target picture 0+1) is I-picture, anticipated quantity of generated bits of the picture which is 

TpG+1) expresses the target bit quantity in the case where ahead of the codin g tar g et P icture b ? the predetermined 

the coding target picture (j+1) is P-picture, DUmber of P lctures 15 found b y distributmg the bit quantity 

t,/. 1X 4 . . .„ ... • .u u 25 allocated to non-coded pictures at and after the picture 

Tbn+1) expresses the target bit quantity in the case where ,. , . . , , . y t , » «"y F ivh.iv 

.u a' * * • * r i\ ■ r> ■ 4 which is ahead by the predetermined number of pictures in 

the coding target picture Q+l) is B-picture, A . ■ t J . ■ i ■ * * , 

„ y . v , . . . „ t , the GOP including the picture which is ahead by the 

R0+1) expresses the bit quantity allocated to the non- predetermined number of pictures, in accordance with the 

coded pictures at and after the picture 0+1) in the GOP picture t of the ictUfe wfaich is ahead b me edetef . 

including the target picture 0+1), 30 mined number of pictures. 

Xi expresses global complexity indicating complexity of 17. The coding device as claimed in claim 16, wherein the 

a screen of I-picture, b (t quantity allocated to non-coded pictures at and after the 

Xp expresses global complexity indicating complexity of picture which is ahead by the predetermined number of 

a screen of P-picture, pictures is corrected by using a value obtained by multiply- 

Xb expresses global complexity indicating complexity of 35 ing the difference between a bit quantity per picture at the 

a screen of B-picture, first bit rate and a bit quantity per picture at the second bit 

Np expresses the number of non-coded P-pictures in the rate °y the number of non-coded pictures at and after the 

GOP including the coding target picture 0+1), picture which is ahead by the predetermined number of 

Nb expresses the number of non-coded B-pictures in the P ictures in the G0P includin f the picture which is ahead by 

GOP including the coding target picture Q + l), 40 the predetermined number of pictures. 

„ . r 4 . 1 1 r 18. The coding device as claimed ui claim 17, wherein in 

Kp expresses the ratio of a quantizer scale code of tbe casewhere a leadingpicture ofa next G0P fa co ded after 

P-picture with reference to a quantizer scale code of . , . • . • j- . 1 i_ c .i_ 

I icture and coding pictures up to a picture immediately before the 

-pic ure, an coding target picture at the first bit rate and coding pictures 

Kb expresses the ratio of a quantizer scale code of 45 from the target piclure at thc second 5it ratCj the 

B-picture with reference to the quantizer scale code of control means ^neCls the bit quantity allocated to non- 

I-picture. coded pictures of the next GOP by using a correction value 

12. The coding device as claimed in claim 1, wherein in generated as a result of coding processing of the GOP 
coding pictures up to a picture immediately before the including the coding target picture. 

coding target picture at the first bit rate and coding pictures 50 19 ^ coding device ^ claimed ^ claim lg wherein the 

from the coding target picture at the second bit rate, correction value is obtained by using a value obtained by 

the control means calculates the bit quantity allocated to subtracting the quantity of generated bits generated by actual 

a predetermined number of non-coded pictures at and coding processing of the last picture of the GOP including 

after the coding target picture and detects difiSculty the coding target picture from the target bit quantity allo- 

indicating coding difficulty of the predetermined num- 55 cated to the last picture. 

ber of non-coded pictures, and 20. The coding device as claimed in claim 12, wherein an 

finds the target bit quantity allocated to the coding target algorithm for calculating the target bit quantity of the coding 

picture by distributing the bit quantity of the predeter- target picture in the control means is a feed-forward type 

mined number of non-coded pictures on the basis of the algorithm for detecting difficulty indicating coding difficulty 

difficulty of the coding target picture. 60 of a predetermined number of non-coded pictures including 

13. The coding device as claimed in claim 12, wherein the the coding target picture, and calculating the target bit 
control means corrects the bit quantity of the predetermined quantity of the coding target picture on the basis of the 
number of non-coded pictures in accordance with the dif- difficulty of the predetermined number of non-coded pre- 
ference between the first bit rate and the second bit rate, and hires and the difficulty of the coding target picture, before 
calculates the target bit quantity of the coding target picture 65 coding processing of the coding target picture. 

on the basis of the corrected bit quantity of the predeter- 21. The coding device as claimed in claim 1, wherein in 

mined number of non-coded pictures. coding a coding target picture 0+1) as a (j+l)th picture in the 
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GOP, a bit quantity R'(j+1) allocated to L non-coded pictures 
from the coding target picture (j+1) to a picture (j+L) is 
calculated in accordance with the following equation, 

R'G+iJ-R'OSOHFO+L) s 

where R'(j) expresses the bit quantity allocated to L 
non-coded pictures from a picture (j) to a picture 

G-i+L), 

ex P resses tne bit quantity generated as a result of 10 
coding processing of the picture (j), and 
F(j+L) expresses an anticipated quantity of generated bits 

of the picture (j+L). 
22. The coding device as claimed in claim 21, wherein the 
anticipated quantity of generated bits F(j+L) of the picture 
(j+L) is calculated in accordance with the following 
equations, 



is 



FiG'+l>max(G(i+L)/(l +NpXp/XiKp+NbXb/XiKb), 

bit_rate/8xpic_rate) 
Fp(j+L)-max (G(j+L)/(Np+NbKpXb/KbXp), bit_rate/8xpic rate) 
Fb(j+L)-max (G(j+L)/(Nb+NpKbXp/KpXb), bit_rate/8xpic-rate) 



20 



25 



where Fi(j+L) expresses the target bit quantity in the case 

where the picture (j+L) is I-picture, 
Fp(j+L) expresses the target bit quantity in the case where 

the picture (j+L) is P-picture, 
Fb(j+L) expresses the target bit quantity in the case where 

the picture (j+L) is B-picture, 
G(j+L) expresses the bit quantity allocated to the non- 
coded pictures at and after the picture (j+L) in the GOP 

including the picture (j+L), 
Xi expresses global complexity indicating complexity of 

a screen of I-picture, 
Xp expresses global complexity indicating complexity of 

a screen of P-picture, 
Xb expresses global complexity indicating complexity of 

a screen of B-picture, 
Np expresses the number of non -coded P-pictures in the 

GOP including the picture (j+L), 
Nb expresses the number of non-coded B-pictures in the 45 

GOP including the picture (j+L), 
Kp expresses the ratio of a quantizer scale code of 

P-picture with reference to a quantizer scale code of 

I-picture, and 

Kb expresses the ratio of a quantizer scale code of 50 
B-picture with reference to the quantizer scale code of 
I-picture. 
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picture of the GOP and the designated bit rate is changed 
from the first bit rate to the second bit rate in a GOP which 
is temporally preceding the GOP including the coding target 
picture (j+l)> 

the bit quantity R'(j+1) of L non-coded pictures at and 
after the coding target picture (j+1) and the bit quantity 
G(j+1) of L non-coded pictures at and after the coding 
target picture (j+1) in the GOP including the coding 
target picture (j+1) are found in accordance with the 
following equations, 

R'(j+l)-(bit_rate(2)-bit_rate(l))xL/pic_ratc+R , 0'+l) 
G<j+l)-bit_ralc(2)xN/pic_j-atc+G(j+l)+e 

where bit rate(l) expresses the first bit rate, 

bit_rate(2) expresses the second bit rate, 

N expresses the number of pictures included in the GOP, 

pic__rate expresses the frame rate, 

G(j+1) expresses the remaining bit quantity as a result of 

coding processing of the last picture of the GOP 

including the picture (j), and 
e expresses the correction bit quantity supplied to a GOP 

next to the GOP including the picture (j+1). 

25. The coding device as claimed in claim 23, wherein in 
the case where the coding target picture (j+1) is a picture at 
a halfway point in the GOP and where pictures up to the 
picture (j) are coded at the first bit rate and pictures from the 
picture (j+1) are coded at the second bit rate, 

the bit quantity R'(j+1) of L non-coded pictures at and 
after the coding target picture (j+1) and the bit quantity 
G(j+1) of L non -coded pictures at and after the coding 
target picture (j+1) in the GOP including the coding 
target picture (j+1) are found in accordance with the 
following equations, 

R'(j+l)=(bit_rate(j+l)-bit_rate(j))xL/pic_rate+R , (j+l) 
GG+l)=(bit_ratc(j+l)-bit_ratc(j))xN/pic_iate+G(i+l)+e 

where bit rate(j) expresses the first bit rate designated to 

the GOP including the picture (j), 
bit_rate(j+l) expresses the second bit rate designated to 

the GOP including the picture Q+l), 
N expresses the number of pictures included in the GOP, 
pic_rate expresses the frame rate, 
G(j+1) expresses the remaining bit quantity as a result of 
coding processing of the last picture of the GOP 
including the picture (j), and 
e expresses the correction bit quantity supplied to a GOP 
next to the GOP including the picture (j+1). 

26. The coding device as claimed in claim 25, wherein a 
target bit quantity T(j+1) allocated to the coding target 



23. The coding device as claimed in claim 22, wherein the 
bit quantity G(j+L) allocated to non-coded pictures at and 
after the picture (j+L) in the GOP including the picture (j+L) 55 picture (j+1) is calculated in accordance with the following 
is found in accordance with the following equation, equation, 



GG+L)=GG+L-1)-FG>L-1) 

where G (j+L-1) expresses the bit quantity allocated to 
non-coded pictures at and after a picture (j+L-1) in the 
GOP including the picture (j+L), and 

F(j+L-1) expresses an anticipated quantity of generated 
bits of the picture (j+L-1). 

24. The coding device as claimed in claim 23, wherein in 
the case where the coding target picture (j+1) is the first 



60 



65 



TG+l)-max(R'(i+l)xD(i+l)/2:D(k) ) bit_rateG+l)/8xpic_rate) 

where D(j+1) expresses difficulty of the coding target 
picture Q+l), and 

2D(k) expresses a value obtained by adding difficulty of 
pictures from the picture (j+1) to the picture (j+l+L). 

27. A coding device for coding video data on the basis of 
a designated bit rate, the device comprising: 

control means for calculating a target bit quantity allo- 
cated to a coding target picture on the basis of a bit 
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quantity allocated to non-coded pictures in a GOP and 
the designated bit rate; and 

coding means for coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control means; 5 

the control means correcting the target bit quantity pro- 
vided to the coding means from a target bit quantity 
corresponding to a first bit rate to a target bit quantity 
corresponding to a second bit rate in the case where the 
designated bit rate is changed from the first bit rate to 10 
the second bit rate at a halfway point in the GOP. 

28. A coding device for coding video data on the basis of 
designated bit rate, the device comprising: 

control means for calculating a target bit quantity allo- 
cated to a coding target picture from a bit quantity 35 
allocated to non-coded pictures in a GOP; and 

coding means for coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control means; 

the control means correcting the bit quantity of non-coded 20 
pictures so that the locus of change of the bit quantity 
of non-coded pictures becomes the locus at the time 
when each picture is coded at a second bit rate from a 
leading picture of the GOP, in the case where the 
designated bit rate is changed from a first bit rate to the 25 
second bit rate at a halfway point in the GOP, the 
control means calculating the target bit quantity allo- 
cated to the coding target picture on the basis of the 
corrected bit quantity of non-coded pictures. 

29. A coding device for coding video data on the basis of 
designated bit rate, the device comprising: 

control means for calculating a target bit quantity allo- 
cated to a coding target picture from a bit quantity 
allocated to non-coded pictures in a GOP; and 35 

coding means for coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control means; 

the control means correcting the bit quantity of non-coded 
pictures from a bit quantity of non-coded pictures based 40 
on a first bit rate to a bit quantity of non-coded pictures 
based on a second bit rate in the case where the 
designated bit rate is changed from the first bit rate to 
the second bit rate at a halfway point in the GOP, the 
control means calculating the target bit quantity alio- 45 
cated to the coding target picture on the basis of the 
corrected bit quantity of non-coded pictures. 

30. A coding device for coding video data on the basis of 
designated bit rate, the device comprising: 

control means for calculating an anticipated bit quantity 50 
allocated to non-coded pictures up to a picture which is 
ahead of a coding target picture by a predetermined 
number of pictures and distributing the anticipated bit 
quantity on the basis of coding difficulty of the coding 
target picture so as to calculate a target bit quantity 55 
allocated to the coding target picture; and 

coding means for coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control means; 

the control means correcting the target bit quantity pro- 60 
vided to the coding means from a target bit quantity 
corresponding to a first bit rate to a target bit quantity 
corresponding to a second bit rate in the case where the 
designated bit rate is changed from the first bit rate to 
the second bit rate at a halfway point in a GOP. 65 

31. A coding device for coding video data on the basis of 
designated bit rate, the device comprising: 



control means for calculating an anticipated bit quantity 
allocated to non-coded pictures up to a picture which is 
ahead of a coding target picture by a predetermined 
number of pictures and distributing the anticipated bit 
quantity on the basis of coding difficulty of the coding 
target picture so as to calculate a target bit quantity 
allocated to the coding target picture; and 

coding means for coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control means; 

the control means correcting the anticipated bit quantity 
allocated to non-coded pictures so that the locus of 
change of the anticipated bit quantity allocated to 
non-coded pictures becomes the locus at the time when 
each picture is coded at a second bit rate, in the case 
where the designated bit rate is changed from a first bit 
rate to the second bit rate at a halfway point in a GOP, 
the control means calculating the target bit quantity 
allocated to the coding target picture on the basis of the 
corrected bit quantity. 

32. A coding device for coding video data on the basis of 
a designated bit rate, the device comprising: 

control means for calculating an anticipated bit quantity 
allocated to non-coded pictures up to a picture which is 
ahead of a coding target picture by a predetermined 
number of pictures and distributing the anticipated bit 
quantity on the basis of coding difficulty of the coding 
target picture so as to calculate a target bit quantity 
allocated to the coding target picture; and 

coding means for coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control means; 

the control means correcting the bit quantity allocated 
non-coded pictures from a bit quantity of non-coded 
pictures based on a first bit rate to a bit quantity of 
non-coded pictures based on a second bit rate in the 
case where the designated bit rate is changed from the 
first bit rate to the second bit rate at a halfway point in 
a GOP, the control means calculating the target bit 
quantity allocated to the coding target picture on the 
basis of the corrected bit quantity of non-coded pic- 
tures. 

33. A coding method for coding video data on the basis of 
a designated bit rate, the method comprising: 

a control step of calculating a target bit quantity allocated 
to each picture included in a GOP on the basis of the 
designated bit rate; and 

a coding step of coding a coding target picture on the basis 
of the target bit quantity controlled by the control step; 

wherein at the control step, when the designated bit rate 
is changed from a first bit rate to a second bit rate in the 
case where coding processing of the coding target 
picture is carried out by the coding step, the target bit 
quantity allocated to- the coding target picture is cor- 
rected on the basis of the difference between the first bit 
rate and the second bit rate. 

34. A coding method for coding video data on the basis of 
a designated bit rate, the method comprising: 

a control step of calculating a target bit quantity allocated 
to a coding target picture on the basis of a bit quantity 
allocated to non -coded pictures in a GOP and the 
designated bit rate; and 

a coding step of coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control step; 
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wherein at the control step, in the case where the desig- 
nated bit rate is changed from a first bit rate to a second 
bit rate at a halfway point in the GOP, the target bit 
quantity provided to the coding step is corrected from 
a target bit quantity corresponding to the first bit rate to 5 
a target bit quantity corresponding to the second bit 
rate. 

35. A coding method for coding video data on the basis of 
designated bit rate, the method comprising: 

a control step of calculating a target bit quantity allocated 10 
to a coding target picture from a bit quantity allocated 
to non-coded pictures in a GOP; and 

a coding step of coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control step; 15 

wherein at the control step, in the case where the desig- 
nated bit rate is changed f rom a first bit rate to a second 
bit rate at a halfway point in the GOP, the bit quantity 
of non-coded pictures is corrected so that the locus of 2Q 
change of the bit quantity of non-coded pictures 
becomes the locus at the time when each picture is 
coded at the second bit rate from a leading picture of 
the GOP, and the target bit quantity allocated to the 
coding target picture is calculated on the basis of the 25 
corrected bit quantity of non-coded pictures. 

36. A coding method for coding video data on the basis of 
designated bit rate, the method comprising: 

a control step of calculating a target bit quantity allocated 

to a coding target picture from a bit quantity allocated 30 

to non -coded pictures in a GOP; and 
a coding step of coding the coding target picture in 

accordance with the target bit quantity calculated by the 

control step; 

wherein at the control step, in the case where the desig- 35 
nated bit rate is changed from a first bit rate to a second 
bit rate at a halfway point in the GOP, the bit quantity 
of non-coded pictures is corrected from a bit quantity of 
non-coded pictures based on the first bit rate to a bit 
quantity of non-coded pictures based on the second bit 40 
rate, and the target bit quantity allocated to the coding 
target picture is calculated on the basis of the corrected 
bit quantity of non-coded pictures. 

37. A coding method for coding video data on the basis of 
designated bit rate, the method comprising: 45 
a control step of calculating an anticipated bit quantity 

allocated to non-coded pictures up to a picture which is 
ahead of a coding target picture by a predetermined 
number of pictures and distributing the anticipated bit 
quantity on the basis of coding difficulty of the coding 50 
target picture so as to calculate a target bit quantity 
allocated to the coding target picture; and 
a coding step of coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control step; 
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wherein at the control step, in the case where the desig- 
nated bit rate is changed from a first bit rate to a second 
bit rate at a halfway point in a GOP, the target bit 
quantity provided to the coding step is corrected from 
a target bit quantity corresponding to the first bit rate to 
a target bit quantity corresponding to the second bit 
rate. 

38. A coding method for coding video data on the basis of 
a designated bit rate, the method comprising: 

a control step of calculating an anticipated bit quantity 
allocated to non-coded pictures up to a picture which is 
ahead of a coding target picture by a predetermined 
number of pictures and distributing the anticipated bit 
quantity on the basis of coding difficulty of the coding 
target picture so as to calculate a target bit quantity 
allocated to the coding target picture; and 

a coding step of coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control step; 

wherein at the control step, in the case where the desig- 
nated bit rate is changed from a first bit rate to a second 
bit rate at a halfway point in a GOP, the anticipated bit 
quantity allocated to non-coded pictures is corrected so 
that the locus of change of the anticipated bit quantity 
allocated to non-coded pictures becomes the locus at 
the time when each picture is coded at the second bit 
rate, and the target bit quantity allocated to the coding 
target picture is calculated on the basis of the corrected 
bit quantity. 

39. A coding method for coding video data on the basis of 
a designated bit rate, the method comprising: 

a control step of calculating an anticipated bit quantity 
allocated to non-coded pictures up to a picture which is 
ahead of a coding target picture by a predetermined 
number of pictures and distributing the anticipated bit 
quantity on the basis of coding difficulty of the coding 
target picture so as to calculate a target bit quantity 
allocated to the coding target picture; and 

a coding step of coding the coding target picture in 
accordance with the target bit quantity calculated by the 
control step; 

wherein at the control step, in the case where the desig- 
nated bit rate is changed from a first bit rate to a second 
bit rate at a halfway point in a GOP, the bit quantity 
allocated non-coded pictures from a bit quantity of 
non-coded pictures based on the first bit rate to a bit 
quantity of non-coded pictures based on the second bit 
rate, and the target bit quantity allocated to the coding 
target picture is calculated on the basis of the corrected 
bit quantity of non-coded pictures. 

* * * * * 
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